-- Logs begin at Thu 2022-05-12 08:51:35 UTC, end at Thu 2022-05-12 10:02:09 UTC. -- May 12 09:24:55.120968 dv-cinder-837699-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 09:24:55.130493 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 09:24:55.133093 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 09:24:55 2022] *** May 12 09:24:55.133093 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 09:24:55.133093 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 09:24:55.133093 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: nodename: dv-cinder-837699-5-iscsi May 12 09:24:55.133093 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: machine: x86_64 May 12 09:24:55.133093 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: clock source: unix May 12 09:24:55.133093 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: pcre jit disabled May 12 09:24:55.133574 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: detected number of CPU cores: 4 May 12 09:24:55.133574 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: current working directory: / May 12 09:24:55.133574 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: detected binary path: /usr/bin/uwsgi-core May 12 09:24:55.133574 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: your processes number limit is 47680 May 12 09:24:55.133574 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: your memory page size is 4096 bytes May 12 09:24:55.133574 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: detected max file descriptor number: 2048 May 12 09:24:55.133574 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: lock engine: pthread robust mutexes May 12 09:24:55.133574 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: thunder lock: enabled May 12 09:24:55.134257 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 09:24:55.134257 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 09:24:55.180268 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: Python main interpreter initialized at 0x56492bb599c0 May 12 09:24:55.180268 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: python threads support enabled May 12 09:24:55.180268 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: your server socket listen backlog is limited to 100 connections May 12 09:24:55.180268 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: your mercy for graceful operations on workers is 90 seconds May 12 09:24:55.180627 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: mapped 403077 bytes (393 KB) for 2 cores May 12 09:24:55.180705 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: *** Operational MODE: preforking *** May 12 09:24:55.180939 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: *** uWSGI is running in multiple interpreter mode *** May 12 09:24:55.180939 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: spawned uWSGI master process (pid: 102534) May 12 09:24:55.181137 dv-cinder-837699-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 09:24:55.181713 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: spawned uWSGI worker 1 (pid: 102535, cores: 1) May 12 09:24:55.182585 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: spawned uWSGI worker 2 (pid: 102536, cores: 1) May 12 09:24:55.182585 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 09:24:56.381347 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 09:24:56.402442 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 09:24:57.105067 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:24:57.105067 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: from cryptography.utils import int_from_bytes May 12 09:24:57.105394 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:24:57.105394 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: from cryptography.utils import int_from_bytes May 12 09:24:57.112748 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:24:57.112748 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: from cryptography.utils import int_from_bytes May 12 09:24:57.113082 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:24:57.113082 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: from cryptography.utils import int_from_bytes May 12 09:24:59.717528 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 09:24:59.718160 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 09:24:59.718320 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 09:24:59.718681 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 09:24:59.718937 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 09:24:59.719319 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.719644 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.719963 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.720280 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.720608 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.720917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.721256 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.721583 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.721921 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.722203 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.722520 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.722846 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-5-iscsi {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.723166 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.723473 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.723780 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.724095 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.724369 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 09:24:59.724754 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.724846 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 09:24:59.724937 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.725031 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.725154 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 09:24:59.725471 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.725612 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 09:24:59.725751 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 09:24:59.725932 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.726170 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.726295 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.726502 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.726618 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.726830 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.726960 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.727161 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.727320 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.727464 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.727561 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.727786 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.727887 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.728094 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.728193 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.728414 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.728507 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.728722 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.728817 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.728997 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.729097 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-5-iscsi {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.729321 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.729412 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.729650 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-5-iscsi {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.729751 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.730000 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.730110 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.730313 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.730434 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.730630 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.730744 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.730954 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.731058 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.731263 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.731364 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.731589 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.731681 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.731902 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.732026 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.732261 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.732408 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.732577 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.732725 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.732893 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.733036 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.733209 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.733352 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.733507 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.733692 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.733801 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.734033 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.734124 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.734349 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.734448 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.734671 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.734765 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.734985 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.735077 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.735235 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.735321 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.735539 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.735626 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.735856 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.736002 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-5-iscsi {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.736175 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.736321 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.736494 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.736639 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.736734 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.737496 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.737617 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.737820 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.737960 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.738161 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.738278 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.738466 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.738590 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.738772 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.738917 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.739076 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.739246 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.739380 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.739559 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.739684 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.739888 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.739991 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.740213 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.740315 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.740535 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.740636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.740860 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.740954 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.741164 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.741252 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.741477 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.741573 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.741779 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.741876 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.742118 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.742218 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.742428 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.742522 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.742737 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.742833 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.742991 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.743080 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.743303 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.743398 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.743632 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.743743 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.743953 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.744058 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.744268 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.744374 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.744522 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.744617 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.744779 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.744867 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.745108 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.745281 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.745434 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.745529 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.745749 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.745843 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.746087 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.746178 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.746389 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.746474 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.746639 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.746733 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.746939 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.747026 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.747243 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.747336 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.747567 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.747673 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.747865 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.747959 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.748171 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.748265 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.748473 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.748568 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.748770 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.748865 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.749074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.749161 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.749377 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.749475 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.749680 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.749794 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.750009 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.750110 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.750315 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.750411 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.750616 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.750702 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.750919 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.751012 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.751222 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.751321 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.751524 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.751620 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.751836 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.751999 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.752150 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.752247 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.752453 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.752601 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.753313 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.753410 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.753619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.753720 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.753945 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.754039 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.754524 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.754621 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.754805 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.754904 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.755120 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.755206 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.755432 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.755525 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.755735 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.755833 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.756039 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.756132 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.756354 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.756445 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.756658 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.756744 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.756962 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.757055 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.757275 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.757361 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.757571 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.757722 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.757878 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.757988 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.758212 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.758300 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.758516 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.758608 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.758820 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.758950 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.759122 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.759215 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.759425 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.759512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.759726 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.759819 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.760028 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.760114 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.760329 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.760417 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.760632 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.760719 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.760930 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.761025 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.761244 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.761337 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.761553 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.761647 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.761858 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.761984 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.762188 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.762281 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.762491 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.762589 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.762808 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.762902 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.763114 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.763211 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.763425 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.763512 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.763746 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.763853 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.764058 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.764163 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.764369 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.764461 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.764692 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.764794 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.764997 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.765084 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.765307 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.765399 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.765620 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.765708 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.765949 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.766049 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.766261 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.766354 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.766567 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.766653 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.766875 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.766962 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.767181 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.767265 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.767492 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.767579 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.767799 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.767904 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.768102 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.770084 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.770192 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.770276 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.770355 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.770440 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.770440 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.770601 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.770682 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.770761 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.770761 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.770902 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.770986 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.771073 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.771073 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.771222 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:24:59.771303 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.771388 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.771473 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.771566 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.771647 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.771750 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.771841 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.771922 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.772001 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.772088 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.772176 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.772286 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.772484 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.772610 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.772791 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.772928 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.773109 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.773249 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.773441 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.773583 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.773752 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.773935 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.774102 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.774242 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.774417 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.774561 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.774731 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.774886 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.775041 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.775218 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.775351 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.775552 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.775648 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.775876 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.775984 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.776200 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.776331 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.776526 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.776622 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.776845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.776933 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.777170 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.777266 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.777497 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.777596 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.777814 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.777975 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.778150 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.778252 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.778454 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.778551 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.778758 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.778853 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.779060 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.779148 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.779366 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.779454 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.779667 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.779755 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.779986 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.780083 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.780309 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.780397 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.780614 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.780707 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.780945 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.781043 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.781250 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.781339 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.781557 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.781644 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.781866 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.782023 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.782198 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.782297 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.782503 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.782596 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.782814 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.782910 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.783122 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.783209 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.783427 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.783513 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.783773 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.783890 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.784106 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.784195 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.784413 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.784501 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.784737 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.784832 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.785043 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.785129 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.785349 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.785444 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.785662 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.785758 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.785995 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.786086 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.786306 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.786393 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.786614 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.786701 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.786921 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.787007 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.787235 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.787329 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.787546 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.787634 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.787862 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.787949 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.788192 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.788281 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.788504 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.788593 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.788811 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.788896 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.789134 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.789231 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.789446 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.789543 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.789760 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.789846 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.790096 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.790199 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.790407 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.790494 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.790725 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.790812 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.791033 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.791135 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.791336 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.791425 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.791641 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.791736 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.791943 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.792038 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.792245 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.792334 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.792546 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.792632 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.792847 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.792951 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.793148 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.793235 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.793468 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.793597 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.793772 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.793867 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.794098 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.794194 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.794400 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.794540 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.794690 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.794862 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.795024 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.795156 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.795328 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.795460 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.795667 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.795798 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.795977 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.796121 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.796291 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.796422 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.796608 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.796739 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.796917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.797049 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.797228 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.797368 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.797536 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.797668 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.797851 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.798018 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.798201 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.798357 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.798504 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.798638 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.798774 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.798916 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.799079 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.799220 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.799899 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.800041 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.800214 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.800345 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.800525 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.800673 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.800833 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.800967 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.801141 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.801271 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.801445 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.801575 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.801758 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.801914 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.802092 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.802222 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.802405 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.802544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.802716 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.802847 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.803024 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.803155 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.803351 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.803486 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.803663 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.803799 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.803971 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.804114 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.804282 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.804433 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.804596 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.804733 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.804869 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.805033 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.805190 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.805331 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.805500 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.805633 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.805817 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.806014 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.806153 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.806290 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.806456 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.806602 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.806762 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.806901 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.807079 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.807221 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.807382 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.807523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.807691 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.807835 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.808016 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.808147 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.808349 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.808481 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.808656 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.808794 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.808966 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.809102 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.809276 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.809405 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.809582 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.809718 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.809890 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.810045 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.810220 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.810351 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.810528 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.810670 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.810833 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.810965 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.811143 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.811282 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.811457 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.811597 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.811763 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.811895 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.812070 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.812202 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.812372 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.812503 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.812682 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.812823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.812986 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.813133 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.813287 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.813418 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.813589 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.813728 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.813908 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.814054 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.814242 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.814380 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.814550 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.814696 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.814868 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.815023 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.815248 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.815398 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.816047 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.816199 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.816357 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.816498 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.816677 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.816815 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.816983 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.817133 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.817279 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.817416 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.817573 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.817704 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.817875 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.818049 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.818241 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.818417 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.818551 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.818638 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.818853 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.818939 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.819162 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.819249 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.819478 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.819564 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.819787 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.819882 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.820100 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.820198 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.820408 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.820495 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.820716 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.820814 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.821034 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.821120 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.821346 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.821439 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.821649 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.821747 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.821985 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.822076 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.822301 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.822388 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.822611 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.822707 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.822921 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.823009 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.823243 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.823330 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.823551 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.823646 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.823862 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.823948 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.824169 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.824266 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.824470 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.824610 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.824778 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.824865 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.825090 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.825214 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.825399 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.825654 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.825751 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.826005 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.826096 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.826321 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.826421 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.826636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.826723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.826954 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.827041 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.827271 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.827366 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.827599 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.827692 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.827919 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.828012 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.828237 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.828324 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.828554 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.828688 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.828864 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.828976 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.829167 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.829267 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.829471 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.829573 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.829779 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.829877 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.830107 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.830226 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.830410 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.830509 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.830748 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.830846 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.831056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.831163 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.831359 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.831458 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.831661 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.831761 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.831962 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.832070 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.832263 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.832362 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.832575 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.832672 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.832874 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.832981 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.833182 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.833453 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.833553 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.833786 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.833911 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.834115 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.834228 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.834427 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.834526 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.834713 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.834822 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.835013 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.835112 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.835355 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.835454 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.835657 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.835765 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.835989 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.836089 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.836315 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.836423 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.836651 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.836750 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.836954 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.837054 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.837256 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.837363 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.837571 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.837670 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.837871 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.837988 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.838197 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.838300 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.838499 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.838612 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.838807 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.838906 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.839110 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.839204 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.839409 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.839516 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.839716 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.839805 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.840022 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.840111 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.840329 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.840435 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.840634 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.840732 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.840934 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.841025 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.841238 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.841336 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.841539 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.841635 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.841850 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.841959 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.842180 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.842287 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.842481 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.842569 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.842781 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.842868 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.843088 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.843179 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.843391 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.843479 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.843691 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.843779 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.843997 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.844095 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.844297 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.844394 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.844608 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.844698 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.844908 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.845001 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.845209 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.845299 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.845509 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.845611 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.845814 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.845928 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.846144 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.846233 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.846473 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.846574 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.846792 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.846895 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.847100 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.847196 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.847402 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.847502 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.847702 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.847791 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.848010 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.848100 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.848310 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.848410 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.848610 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.848737 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.848916 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.849016 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.849234 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.849363 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.849546 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.849648 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.849845 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.849957 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.850174 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.850265 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.850478 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.850576 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.850777 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.850865 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.851076 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.851167 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.851379 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.851467 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.851677 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.851778 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.851984 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.852121 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.852277 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.852376 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.852574 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.852674 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.852872 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.852967 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.853178 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.853265 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.853478 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.853572 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.853777 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.853864 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.854106 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.854206 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.854406 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.854504 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.854747 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.854849 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.855052 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.855150 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.855387 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.855483 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.855695 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.855781 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.855998 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.856083 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.856310 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.856398 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.856617 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.856702 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.856925 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.857012 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.857235 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.857322 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.857536 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.857630 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.857846 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.857951 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.858179 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.858269 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.858487 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.858574 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.858807 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.858980 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.859139 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.859276 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.859428 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.859563 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.859702 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.859850 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.860001 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.860139 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.860285 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.860423 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.860568 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.860715 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.860865 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.861003 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.861148 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.861284 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.861454 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.861603 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.861764 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.862404 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.862600 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.862689 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.862907 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.863007 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.863213 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.863302 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.863521 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.863616 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.863830 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.863933 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.864139 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.864229 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.864447 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.864535 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.864754 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.864844 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.865057 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.865194 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.865362 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.865459 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.865667 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.865764 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.865990 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.866084 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.866313 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.866404 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.866618 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.866708 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.866918 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.867015 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.867223 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.867319 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.867524 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.867614 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.867830 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.867925 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.868138 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.868237 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.868462 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.868570 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.868792 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.868880 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.869123 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.869222 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.869433 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.869562 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.869749 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.869839 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.870080 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.870186 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.870393 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.870481 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.870701 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.870802 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.871003 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.871101 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.871317 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.871404 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.871636 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.871724 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.871953 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.872043 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.872269 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.872365 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.872585 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.872676 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.872883 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.872980 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.873189 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.873277 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.873499 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.873595 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.873797 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.873886 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.874121 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.874212 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.874424 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.874512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.874742 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.874839 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.875045 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.875140 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.875360 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.875466 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.875677 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.875765 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.875988 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.876076 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.876348 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.876452 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.876730 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.876819 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.877048 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.877137 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.877352 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.877448 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.878222 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.878321 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.878546 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.878694 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.878868 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.879426 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.879523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.879737 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.880042 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.880131 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.880361 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.880620 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.880709 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.880975 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.881285 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.881372 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.881586 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.881822 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.881935 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.882187 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.882289 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.882533 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.882631 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.882849 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.883112 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.883257 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.883455 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.883579 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.883785 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.883875 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.884195 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.884284 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.884517 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.884616 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.884820 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.885078 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.885178 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.885414 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.885641 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.885732 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.886032 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.886269 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.886360 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.886609 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.886878 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.886969 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.887277 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.887403 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.887737 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.887825 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.888061 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.888355 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.888496 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.888824 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.888912 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.889147 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.889462 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.889552 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.889804 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.890102 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.890194 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.890476 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.890689 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.890804 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.891124 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.891296 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.891457 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.891792 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.891888 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.892115 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.892439 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.892530 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.892753 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.893075 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.893205 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.893463 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.893672 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.893790 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.894153 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.894321 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.894583 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.894919 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.895026 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.895242 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.895492 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.895582 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.895895 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.896080 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.896218 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.896532 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.896656 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.896853 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.897167 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.897301 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.897483 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.897817 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.897927 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.898159 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.898482 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.898580 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.898801 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.899114 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.899203 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.899426 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.899738 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.899887 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.900068 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.900333 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.900432 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.900701 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.900976 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.901068 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.901339 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.901584 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.901681 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.905269 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.905386 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.905478 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.905478 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.905687 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.905777 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.905777 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.905976 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906065 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906065 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906214 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906304 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906304 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906471 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906555 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906637 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906637 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906792 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906884 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.906976 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907060 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907060 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907196 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907265 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907265 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907399 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907468 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907593 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907674 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.907928 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.908022 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.908269 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.908357 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.908588 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.908677 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.908936 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.909034 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.909247 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.909336 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.909560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.909656 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.909873 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.910047 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.910213 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.910423 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.910589 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.910763 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.911088 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.911178 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.911416 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.911733 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.911822 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.912054 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.912325 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.912417 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.912688 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.912951 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.913041 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.913316 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.913533 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.913625 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.914015 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.914157 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.914351 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.914480 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.914675 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.914799 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.914997 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.915112 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.915317 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.915431 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.915673 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.915753 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.915993 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.916244 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.916343 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.916658 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.916796 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.916991 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.917129 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.917333 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.917447 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.917653 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.917751 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.918016 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.918110 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.918348 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.918451 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.919640 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.919738 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.919835 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.919913 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.919983 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920062 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920133 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920201 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920268 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920336 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920404 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920479 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920549 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920702 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.920945 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.921099 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.921249 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.921387 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.921524 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.921661 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.921974 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.922127 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.922278 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.922435 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.922697 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.922838 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.923025 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.923161 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.923349 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.923498 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.923674 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.923822 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.923983 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.924133 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.924305 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.924954 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.925157 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.925297 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.925490 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.925639 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.925807 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.925966 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.926146 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.926248 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.926461 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.926561 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.926772 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.926862 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.927081 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.927173 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.927396 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.927497 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.927712 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.927804 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.928037 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.928127 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.928372 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.928471 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.928691 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.928783 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.929003 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.929107 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.929317 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.929415 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.929635 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.929746 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.929985 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.930184 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.930308 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.930498 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.930627 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.930829 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.930933 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.931156 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.931248 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.931477 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.931793 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.931884 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.932113 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.932204 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.932438 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.932527 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.932742 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.932840 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.933048 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.933138 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.933355 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.933445 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.933661 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.933759 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.933997 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.934103 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.934320 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.934410 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.934632 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.934734 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.934935 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.935176 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.935267 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.935499 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.935599 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.935840 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.936062 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.936159 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.936415 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.936506 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.936733 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.936831 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.937059 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.937148 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.937385 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.937474 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.937701 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.937800 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.938030 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.938126 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.938351 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.938439 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.938658 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.938748 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.938961 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.939051 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.939276 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.939375 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.939585 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.939698 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.939894 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.940076 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.940765 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.941036 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.941136 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.941362 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.941452 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.941666 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.941929 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.942038 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.942291 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.942383 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.942613 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.942700 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.942917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.943036 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.943222 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.943311 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.943523 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.943613 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.943832 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.943924 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.944134 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.944222 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.944436 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.944524 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.944739 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.944830 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.945039 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.945127 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.945347 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.945451 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.945651 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.945741 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.945980 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.946073 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.946285 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.946384 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.946593 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.946685 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.946894 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.946984 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.947200 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.947303 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.947523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.947620 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.947859 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.947950 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.948161 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.948259 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.948463 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.948554 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.948770 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.948858 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.949077 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.949181 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.949387 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.949476 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.949698 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.949786 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.950029 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.950136 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.950342 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.950449 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.950659 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.950750 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.950968 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.951184 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.951281 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.951515 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.951605 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.951834 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.951933 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.952182 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.952288 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.952481 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.952570 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.952788 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.952884 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.953091 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.953181 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.953394 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.953493 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.953714 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.953813 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.954047 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.954141 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.954358 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.954448 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.954666 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.954758 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.954972 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.955070 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.955281 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.955371 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.955587 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.955699 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.955927 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.956024 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.956234 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.956492 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.956595 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.956832 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.956920 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.957139 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.957236 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.957445 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.957538 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.957755 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.957845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.958115 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.958208 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.958428 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.958519 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.958740 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.958830 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.959050 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.959149 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.959363 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.959500 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.959671 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.959761 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.959983 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.960071 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.960287 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.960428 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.960592 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.960683 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.960904 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.961003 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.961221 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.961320 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.961537 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.961628 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.961840 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.961987 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.962178 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.962268 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.962494 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.962583 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.962810 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.962909 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.963131 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.963220 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.963476 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.963567 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.963793 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.963883 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.964110 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.964198 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.964417 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.964505 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.964735 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.964825 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.965042 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.965138 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.965355 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.965444 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.965669 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.965760 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.966010 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.966104 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.966333 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.966475 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.966634 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.966732 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.966936 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.967033 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.967238 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.967337 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.967591 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.967689 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.967860 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.967999 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.968166 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.968325 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.968468 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.968654 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.968752 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.968971 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.969076 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.969300 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.969390 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.969628 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.969718 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.969953 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.970056 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.970258 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.970348 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.970563 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.970656 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.970860 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.970960 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.971158 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.971320 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.971492 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.971584 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.971792 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.972094 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.972185 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.972392 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.972688 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.972777 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.972985 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.973260 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.973351 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.973570 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.973790 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.973879 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.974182 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.974386 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.974509 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.974732 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.974821 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.975072 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.975171 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.975437 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.975571 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.975745 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.975994 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.976100 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.976324 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.976472 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.976657 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.976745 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.976974 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.977077 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.977285 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.977520 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.977610 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.977932 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.978113 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.978235 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.978546 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.978691 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.978854 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.979096 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.979372 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.979473 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.979720 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.979809 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.980044 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.980350 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.980449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.980672 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.980930 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.981028 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.981294 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.981525 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.981624 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.981951 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.982141 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.982234 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.982549 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.982755 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.982893 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.983236 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.983358 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.983559 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.983893 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.983982 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.984217 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.984538 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.984628 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.984855 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.985130 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.985232 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.985499 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.985752 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.985849 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.986153 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.986385 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.986495 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.986812 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.987511 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.987665 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.987964 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.988094 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.988284 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.988602 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.988699 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.988922 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.989257 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.989353 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.989590 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.989852 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.989956 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.990247 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.990480 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.990659 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.990894 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.991117 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.991239 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.991524 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.991786 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.991887 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.992170 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.992411 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.992500 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.992799 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.993034 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.993135 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.993424 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.993676 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.993768 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.994079 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.994315 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.994414 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.994733 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.994966 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.995056 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.995386 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.995575 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.995742 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.996063 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.996177 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.996413 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.996755 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.996853 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.997076 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.997329 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.997420 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.997648 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 09:24:59.997747 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:24:59.997953 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 09:25:00.022187 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_db.sqlalchemy.engines [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:25:00.023563 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:25:00.085163 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.context [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13a725-2629-4ace-99a6-21ba5d823ec1(cell1) {{(pid=102536) load_cells /opt/stack/nova/nova/context.py:464}} May 12 09:25:00.085390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.context [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13a725-2629-4ace-99a6-21ba5d823ec1(cell1) {{(pid=102535) load_cells /opt/stack/nova/nova/context.py:464}} May 12 09:25:00.089461 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG oslo_concurrency.lockutils [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:25:00.089569 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:25:00.091046 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG oslo_concurrency.lockutils [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:25:00.091146 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:25:00.091831 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG oslo_concurrency.lockutils [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:25:00.092081 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:25:00.093751 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG oslo_concurrency.lockutils [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:25:00.094063 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:25:00.107911 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_db.sqlalchemy.engines [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:25:00.109814 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:25:00.113544 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_db.sqlalchemy.engines [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:25:00.120420 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:25:00.273794 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_db.sqlalchemy.engines [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:25:00.277309 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG oslo_db.sqlalchemy.engines [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:25:00.608907 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: WARNING keystonemiddleware.auth_token [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 09:25:00.611144 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: WARNING keystonemiddleware.auth_token [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 09:25:00.616717 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: WARNING keystonemiddleware.auth_token [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 09:25:00.618947 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: WARNING keystonemiddleware.auth_token [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 09:25:00.960112 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: WARNING keystonemiddleware.auth_token [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 09:25:00.964419 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: WARNING keystonemiddleware.auth_token [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 09:25:00.966188 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: WARNING keystonemiddleware.auth_token [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 09:25:00.970529 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: WARNING keystonemiddleware.auth_token [None req-f3e6f629-bccc-476f-95fc-1ce08c81d43d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 09:25:00.972729 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56492bb599c0 pid: 102535 (default app) May 12 09:25:00.974822 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:25:00.975980 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 May 12 09:25:00.976398 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Thu May 12 09:25:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:25:00.977106 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56492bb599c0 pid: 102536 (default app) May 12 09:26:18.610427 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:18.611417 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 May 12 09:26:18.611806 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:19.031540 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-a6d4867c-9860-42b8-af67-c58825d9e606 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:19.062670 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-a6d4867c-9860-42b8-af67-c58825d9e606 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.443180 May 12 09:26:19.063640 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Thu May 12 09:26:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:26:21.358673 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:21.360176 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-d19e9b10-62c2-4e10-b133-ce9c447de71b None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 May 12 09:26:21.361814 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:21.425247 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-b7b261cc-db71-440e-904b-08e679b5322b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "id": "c1", "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:21.445005 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:26:21.445005 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: warnings.warn(msg) May 12 09:26:21.473312 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-b7b261cc-db71-440e-904b-08e679b5322b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107066 May 12 09:26:21.474188 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:26:21.698421 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-f81469cc-937b-46fb-bf73-e1f546d2d323 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:21.700728 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:26:21.700728 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: warnings.warn(msg) May 12 09:26:21.750912 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-f81469cc-937b-46fb-bf73-e1f546d2d323 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.268891 May 12 09:26:21.751735 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 12 09:26:21 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:26:24.026924 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-b7b261cc-db71-440e-904b-08e679b5322b admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:24.027948 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-b7b261cc-db71-440e-904b-08e679b5322b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 May 12 09:26:24.028351 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:24.148222 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-0087f5fc-fb58-4356-9a8b-de986823d15e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "name": "ds512M", "swap": 0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:24.166564 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:26:24.166564 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: warnings.warn(msg) May 12 09:26:24.184239 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-0087f5fc-fb58-4356-9a8b-de986823d15e admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147017 May 12 09:26:24.184804 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:26:24.197366 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-a7cff260-94c1-445f-a1f4-05ea2aa9f298 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:24.199231 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:26:24.199231 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: warnings.warn(msg) May 12 09:26:24.239854 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-a7cff260-94c1-445f-a1f4-05ea2aa9f298 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046398 May 12 09:26:24.253968 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 12 09:26:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:26:26.500576 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-0087f5fc-fb58-4356-9a8b-de986823d15e admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:26.501595 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-0087f5fc-fb58-4356-9a8b-de986823d15e admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 May 12 09:26:26.502044 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:26.560537 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-731b8861-6045-43bf-beb6-64f8869bba15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:26.587611 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-731b8861-6045-43bf-beb6-64f8869bba15 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079468 May 12 09:26:26.595193 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:26:26.601387 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-2370a705-5a38-40ef-93c2-d42418aef1b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:26.626064 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-2370a705-5a38-40ef-93c2-d42418aef1b1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029138 May 12 09:26:26.626823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 12 09:26:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:26:28.907248 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-731b8861-6045-43bf-beb6-64f8869bba15 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:28.908260 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-731b8861-6045-43bf-beb6-64f8869bba15 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 12 09:26:28.908661 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:28.970573 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-2b0ae351-6203-4e9c-aee1-68b6e5640eb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3"}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:28.990649 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-2b0ae351-6203-4e9c-aee1-68b6e5640eb1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075773 May 12 09:26:28.991239 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:26:29.003314 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-1863012b-2779-45f5-9ac8-bfc71ff9793b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:29.027878 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-1863012b-2779-45f5-9ac8-bfc71ff9793b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028506 May 12 09:26:29.028482 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 12 09:26:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:26:31.400788 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-2b0ae351-6203-4e9c-aee1-68b6e5640eb1 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:31.401783 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-2b0ae351-6203-4e9c-aee1-68b6e5640eb1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 12 09:26:31.402373 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:31.470392 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-57d1490f-13e0-41f9-9081-f40502e81c20 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "ram": 4096}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:31.490236 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-57d1490f-13e0-41f9-9081-f40502e81c20 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082270 May 12 09:26:31.491579 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:26:31.503950 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-a4b47e9c-e05b-48c0-915e-d08cd594a1df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:31.525282 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-a4b47e9c-e05b-48c0-915e-d08cd594a1df admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025789 May 12 09:26:31.526447 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Thu May 12 09:26:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:26:33.793170 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-57d1490f-13e0-41f9-9081-f40502e81c20 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:33.794246 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-57d1490f-13e0-41f9-9081-f40502e81c20 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 12 09:26:33.794658 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:33.855026 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-ab1ef3c2-4814-4b8a-9f90-a7f7da29442e admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:33.879631 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-ab1ef3c2-4814-4b8a-9f90-a7f7da29442e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078292 May 12 09:26:33.880169 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Thu May 12 09:26:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:26:36.200406 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-57d1490f-13e0-41f9-9081-f40502e81c20 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:36.202023 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-57d1490f-13e0-41f9-9081-f40502e81c20 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002275 May 12 09:26:36.203222 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:36.264029 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-6a0018fb-c808-4590-b457-341ae979c64a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "swap": 0, "ram": 512}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:36.282562 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-6a0018fb-c808-4590-b457-341ae979c64a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071228 May 12 09:26:36.283123 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:26:36.300222 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-75ca3ece-5a6c-499f-ac1b-df226acca536 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:36.331329 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-75ca3ece-5a6c-499f-ac1b-df226acca536 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036495 May 12 09:26:36.332218 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 12 09:26:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:26:39.263535 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-6a0018fb-c808-4590-b457-341ae979c64a admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:39.264574 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-6a0018fb-c808-4590-b457-341ae979c64a admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 12 09:26:39.265006 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:39.329111 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-71f0e184-31b2-4035-a204-520d6b5111b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "ram": 2048, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:39.352214 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-71f0e184-31b2-4035-a204-520d6b5111b1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080777 May 12 09:26:39.352873 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:26:39.365312 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-cc0eb2b1-9742-46db-9d39-42f1e107e49d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:39.390900 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-cc0eb2b1-9742-46db-9d39-42f1e107e49d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029032 May 12 09:26:39.391686 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 12 09:26:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:26:41.651985 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-71f0e184-31b2-4035-a204-520d6b5111b1 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:41.653000 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-71f0e184-31b2-4035-a204-520d6b5111b1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 12 09:26:41.653583 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:41.710361 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-177ae7a4-2ab5-44cf-9c7a-96c8b2e8a19b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium"}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:41.727676 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-177ae7a4-2ab5-44cf-9c7a-96c8b2e8a19b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068203 May 12 09:26:41.728214 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:26:41.739528 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-4b5ff500-20c7-4696-9573-22f10cd8515a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:41.761556 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-4b5ff500-20c7-4696-9573-22f10cd8515a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025646 May 12 09:26:41.762291 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 12 09:26:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:26:44.012532 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-177ae7a4-2ab5-44cf-9c7a-96c8b2e8a19b admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:44.013838 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-177ae7a4-2ab5-44cf-9c7a-96c8b2e8a19b admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001784 May 12 09:26:44.014569 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:44.076478 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-68ed2d33-43f6-46ec-ab8b-7a8254253919 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:44.105757 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-68ed2d33-43f6-46ec-ab8b-7a8254253919 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085229 May 12 09:26:44.111432 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:26:44.123010 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-6081e855-0746-47fc-81c7-df0372fbc0a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:44.145694 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-6081e855-0746-47fc-81c7-df0372fbc0a1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026406 May 12 09:26:44.148560 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 12 09:26:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:26:46.406977 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-68ed2d33-43f6-46ec-ab8b-7a8254253919 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:26:46.408032 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-68ed2d33-43f6-46ec-ab8b-7a8254253919 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 12 09:26:46.408445 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:26:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:26:46.472470 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-146cc71e-4895-4088-8c2f-56f9d40566d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "name": "m1.xlarge", "swap": 0, "id": "5", "ram": 16384, "rxtx_factor": 1.0}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:46.490629 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-146cc71e-4895-4088-8c2f-56f9d40566d2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076551 May 12 09:26:46.491705 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Thu May 12 09:26:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 09:26:46.504147 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-b3f51218-0e2c-4933-9585-084ddbd8f810 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:26:46.526259 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-b3f51218-0e2c-4933-9585-084ddbd8f810 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026014 May 12 09:26:46.527047 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Thu May 12 09:26:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:27:10.156291 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-146cc71e-4895-4088-8c2f-56f9d40566d2 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:10.157297 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-146cc71e-4895-4088-8c2f-56f9d40566d2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 May 12 09:27:10.157731 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:27:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:27:10.213991 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-82eb3f6d-2391-487b-810a-b6cfcb500a24 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:10.230497 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-82eb3f6d-2391-487b-810a-b6cfcb500a24 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066662 May 12 09:27:10.231030 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Thu May 12 09:27:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:27:11.230862 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-146cc71e-4895-4088-8c2f-56f9d40566d2 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:11.231860 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-146cc71e-4895-4088-8c2f-56f9d40566d2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 12 09:27:11.232260 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:27:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:27:11.423722 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-950cc854-cce5-4acd-9caf-cab16cea363d admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:11.429221 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.wsgi [None req-950cc854-cce5-4acd-9caf-cab16cea363d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-950cc854-cce5-4acd-9caf-cab16cea363d admin admin] Request method failure captured: May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Accept: application/json May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Accept-Encoding: gzip, deflate May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Connection: keep-alive May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Content-Length: 0 May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Host: 10.222.0.60 May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Openstack-Api-Version: compute 2.90 May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Openstack-System-Scope: None May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: User-Agent: python-novaclient May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Auth-Token: gAAAAABifNLvWz2xmkqRFPmpBOXBPZnXi7crIwNYh15U8eLwzVvNmgrE5L_e_7O-6mJ58aGtdGp78vA4zrPH92I9zJi_XQ3X3UY-cIoWJwDOLI7enIaBeMTRpYJis9CJlR8zj2P0QK8gw1WVNXxjaYl_0gbiDGtJKPxWpzuSXONOR4nYctx2Tl8 May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Domain-Id: None May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Domain-Name: None May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Identity-Status: Confirmed May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Is-Admin-Project: True May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Openstack-Nova-Api-Version: 2.90 May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Domain-Id: default May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Domain-Name: Default May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Name: admin May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Role: reader,admin,member May 12 09:27:11.432560 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Roles: reader,admin,member May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_796065237e2244ba911db9225d3aa52c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/796065237e2244ba911db9225d3aa52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}] May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Tenant: admin May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Tenant-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Tenant-Name: admin May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User: admin May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Domain-Id: default May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Domain-Name: Default May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Id: 025f1b162f424dda98fae8e2f23a6180 May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Name: admin May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: method: > May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: exception: Flavor 42 could not be found. May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: action_args: {'id': '42'} May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:27:11.434367 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:11.435544 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:11.437534 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-950cc854-cce5-4acd-9caf-cab16cea363d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:27:11.438939 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-950cc854-cce5-4acd-9caf-cab16cea363d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061733 May 12 09:27:11.438939 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Thu May 12 09:27:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 09:27:11.444480 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-44b2a9c0-83eb-4df9-b310-8ffb082cdccc admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:11.465786 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-44b2a9c0-83eb-4df9-b310-8ffb082cdccc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024894 May 12 09:27:11.466360 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 12 09:27:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:27:11.475923 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-fc951829-a509-4604-8844-31854a1dbc48 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:11.496899 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-fc951829-a509-4604-8844-31854a1dbc48 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024560 May 12 09:27:11.497416 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 12 09:27:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:27:11.507152 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-85624ad2-9f4b-4bd6-9b8c-06f382c6e810 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:11.512520 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.wsgi [None req-85624ad2-9f4b-4bd6-9b8c-06f382c6e810 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-85624ad2-9f4b-4bd6-9b8c-06f382c6e810 admin admin] Request method failure captured: May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Accept: application/json May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Accept-Encoding: gzip, deflate May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Connection: keep-alive May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Content-Length: 0 May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Host: 10.222.0.60 May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Openstack-Api-Version: compute 2.90 May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Openstack-System-Scope: None May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: User-Agent: python-novaclient May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Auth-Token: gAAAAABifNLvWz2xmkqRFPmpBOXBPZnXi7crIwNYh15U8eLwzVvNmgrE5L_e_7O-6mJ58aGtdGp78vA4zrPH92I9zJi_XQ3X3UY-cIoWJwDOLI7enIaBeMTRpYJis9CJlR8zj2P0QK8gw1WVNXxjaYl_0gbiDGtJKPxWpzuSXONOR4nYctx2Tl8 May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Domain-Id: None May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Domain-Name: None May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Identity-Status: Confirmed May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Is-Admin-Project: True May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Openstack-Nova-Api-Version: 2.90 May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Domain-Id: default May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Domain-Name: Default May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Name: admin May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Role: reader,admin,member May 12 09:27:11.515845 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Roles: reader,admin,member May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_796065237e2244ba911db9225d3aa52c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/796065237e2244ba911db9225d3aa52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}] May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Tenant: admin May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Tenant-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Tenant-Name: admin May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User: admin May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Domain-Id: default May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Domain-Name: Default May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Id: 025f1b162f424dda98fae8e2f23a6180 May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Name: admin May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: method: > May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: exception: Flavor 42 could not be found. May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: action_args: {'id': '42'} May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:27:11.517392 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:11.518390 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:11.519449 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-85624ad2-9f4b-4bd6-9b8c-06f382c6e810 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:27:11.520460 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-85624ad2-9f4b-4bd6-9b8c-06f382c6e810 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013777 May 12 09:27:11.520460 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Thu May 12 09:27:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 09:27:12.405122 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-fc951829-a509-4604-8844-31854a1dbc48 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:12.406215 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-fc951829-a509-4604-8844-31854a1dbc48 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 12 09:27:12.406617 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:27:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:27:12.593099 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-b58d9603-ff53-4029-9ce8-530cc5cc1f6e admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:12.598415 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.wsgi [None req-b58d9603-ff53-4029-9ce8-530cc5cc1f6e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-b58d9603-ff53-4029-9ce8-530cc5cc1f6e admin admin] Request method failure captured: May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Accept: application/json May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Accept-Encoding: gzip, deflate May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Connection: keep-alive May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Content-Length: 0 May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Host: 10.222.0.60 May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Openstack-Api-Version: compute 2.90 May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Openstack-System-Scope: None May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: User-Agent: python-novaclient May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Auth-Token: gAAAAABifNLwOeU6TjCI_MuTdXvGofnCnQ0cNpPcgNxQhkyL9nHppqChzwc9oCyUIfj9rcILjPizHR_KPUqyw7W-qOSVUf9kzlYblmzCXA7moK1700FeR_vcaOMXjsROaAl_gQIYwbkS1dvSGALmxNrhmeBHT010YX3MsVXoMiiQfPQSdzkHskU May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Domain-Id: None May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Domain-Name: None May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Identity-Status: Confirmed May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Is-Admin-Project: True May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Openstack-Nova-Api-Version: 2.90 May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Domain-Id: default May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Domain-Name: Default May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Name: admin May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Role: reader,admin,member May 12 09:27:12.599930 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Roles: reader,admin,member May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_796065237e2244ba911db9225d3aa52c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/796065237e2244ba911db9225d3aa52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}] May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Tenant: admin May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Tenant-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Tenant-Name: admin May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User: admin May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Domain-Id: default May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Domain-Name: Default May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Id: 025f1b162f424dda98fae8e2f23a6180 May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Name: admin May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: method: > May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: exception: Flavor 84 could not be found. May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: action_args: {'id': '84'} May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:27:12.601484 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:12.606723 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:12.608067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-b58d9603-ff53-4029-9ce8-530cc5cc1f6e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:27:12.609375 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-b58d9603-ff53-4029-9ce8-530cc5cc1f6e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059303 May 12 09:27:12.609375 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Thu May 12 09:27:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 09:27:12.611159 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-d03a0427-103e-4744-ab4e-f44272fcc888 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:12.625107 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-d03a0427-103e-4744-ab4e-f44272fcc888 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017528 May 12 09:27:12.625572 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 12 09:27:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:27:12.634925 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-779e691b-969c-4725-9399-0fa57f3ab6d8 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:12.649249 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-779e691b-969c-4725-9399-0fa57f3ab6d8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017765 May 12 09:27:12.649766 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 12 09:27:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:27:12.661347 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-9471b9af-a758-44d6-a073-4711fda049db admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:12.666590 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.wsgi [None req-9471b9af-a758-44d6-a073-4711fda049db admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-9471b9af-a758-44d6-a073-4711fda049db admin admin] Request method failure captured: May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Accept: application/json May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Accept-Encoding: gzip, deflate May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Connection: keep-alive May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Content-Length: 0 May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Host: 10.222.0.60 May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Openstack-Api-Version: compute 2.90 May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Openstack-System-Scope: None May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: User-Agent: python-novaclient May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Auth-Token: gAAAAABifNLwOeU6TjCI_MuTdXvGofnCnQ0cNpPcgNxQhkyL9nHppqChzwc9oCyUIfj9rcILjPizHR_KPUqyw7W-qOSVUf9kzlYblmzCXA7moK1700FeR_vcaOMXjsROaAl_gQIYwbkS1dvSGALmxNrhmeBHT010YX3MsVXoMiiQfPQSdzkHskU May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Domain-Id: None May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Domain-Name: None May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Identity-Status: Confirmed May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Is-Admin-Project: True May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Openstack-Nova-Api-Version: 2.90 May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Domain-Id: default May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Domain-Name: Default May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Name: admin May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Role: reader,admin,member May 12 09:27:12.668074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Roles: reader,admin,member May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_796065237e2244ba911db9225d3aa52c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/796065237e2244ba911db9225d3aa52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}] May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Tenant: admin May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Tenant-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Tenant-Name: admin May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User: admin May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Domain-Id: default May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Domain-Name: Default May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Id: 025f1b162f424dda98fae8e2f23a6180 May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Name: admin May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: method: > May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: exception: Flavor 84 could not be found. May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: action_args: {'id': '84'} May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:27:12.669619 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:12.670636 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:12.671719 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-9471b9af-a758-44d6-a073-4711fda049db admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:27:12.672731 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-9471b9af-a758-44d6-a073-4711fda049db admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011568 May 12 09:27:12.672731 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Thu May 12 09:27:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 09:27:13.556131 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-779e691b-969c-4725-9399-0fa57f3ab6d8 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:13.557137 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-779e691b-969c-4725-9399-0fa57f3ab6d8 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 12 09:27:13.557538 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:27:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:27:13.745350 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-a6ff831c-2c35-406b-a145-3e2eb64fdbb3 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:13.750856 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.wsgi [None req-a6ff831c-2c35-406b-a145-3e2eb64fdbb3 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-a6ff831c-2c35-406b-a145-3e2eb64fdbb3 admin admin] Request method failure captured: May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Accept: application/json May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Accept-Encoding: gzip, deflate May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Connection: keep-alive May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Content-Length: 0 May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Host: 10.222.0.60 May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Openstack-Api-Version: compute 2.90 May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Openstack-System-Scope: None May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: User-Agent: python-novaclient May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Auth-Token: gAAAAABifNLxrn5U7d_hlvF9_v7JHpGomgM3w5neyiMU2BXt18K_UP7dzNaTO0lGEgURhXFHBa5Yfh3ptiumHZAL69aED5wJKO5EE8DmE-ExLU-TJeAwWYrQFSnLcvUj6oaYGrryni83FsZdBeNw5ZGOUTT-82b3HbY1fwIa6vXJZ1DSLUVZm6g May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Domain-Id: None May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Domain-Name: None May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Identity-Status: Confirmed May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Is-Admin-Project: True May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Openstack-Nova-Api-Version: 2.90 May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Domain-Id: default May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Domain-Name: Default May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Project-Name: admin May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Role: reader,admin,member May 12 09:27:13.752332 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Roles: reader,admin,member May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_796065237e2244ba911db9225d3aa52c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/796065237e2244ba911db9225d3aa52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}] May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Tenant: admin May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Tenant-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-Tenant-Name: admin May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User: admin May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Domain-Id: default May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Domain-Name: Default May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Id: 025f1b162f424dda98fae8e2f23a6180 May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: X-User-Name: admin May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: method: > May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: exception: Flavor 451 could not be found. May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: action_args: {'id': '451'} May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:27:13.753917 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:13.755056 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: ERROR nova.api.openstack.wsgi May 12 09:27:13.756116 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-a6ff831c-2c35-406b-a145-3e2eb64fdbb3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:27:13.757121 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-a6ff831c-2c35-406b-a145-3e2eb64fdbb3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058788 May 12 09:27:13.757121 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 12 09:27:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 09:27:13.763838 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-6c5a04fa-075d-4ecf-9322-5907e6bfb706 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:13.777664 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-6c5a04fa-075d-4ecf-9322-5907e6bfb706 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017401 May 12 09:27:13.778158 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 12 09:27:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:27:13.787752 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:13.800822 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016522 May 12 09:27:13.801338 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Thu May 12 09:27:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:27:13.810209 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-2d5ceb15-56b6-420a-9084-d3bb2ae11090 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:13.815433 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.wsgi [None req-2d5ceb15-56b6-420a-9084-d3bb2ae11090 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-2d5ceb15-56b6-420a-9084-d3bb2ae11090 admin admin] Request method failure captured: May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Accept: application/json May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Accept-Encoding: gzip, deflate May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Connection: keep-alive May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Content-Length: 0 May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Host: 10.222.0.60 May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Openstack-Api-Version: compute 2.90 May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Openstack-System-Scope: None May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: User-Agent: python-novaclient May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Auth-Token: gAAAAABifNLxrn5U7d_hlvF9_v7JHpGomgM3w5neyiMU2BXt18K_UP7dzNaTO0lGEgURhXFHBa5Yfh3ptiumHZAL69aED5wJKO5EE8DmE-ExLU-TJeAwWYrQFSnLcvUj6oaYGrryni83FsZdBeNw5ZGOUTT-82b3HbY1fwIa6vXJZ1DSLUVZm6g May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Domain-Id: None May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Domain-Name: None May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Identity-Status: Confirmed May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Is-Admin-Project: True May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Openstack-Nova-Api-Version: 2.90 May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Domain-Id: default May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Domain-Name: Default May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Project-Name: admin May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Role: reader,admin,member May 12 09:27:13.816938 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Roles: reader,admin,member May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_796065237e2244ba911db9225d3aa52c", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/796065237e2244ba911db9225d3aa52c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/796065237e2244ba911db9225d3aa52c"}]}] May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Tenant: admin May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Tenant-Id: 796065237e2244ba911db9225d3aa52c May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-Tenant-Name: admin May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User: admin May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Domain-Id: default May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Domain-Name: Default May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Id: 025f1b162f424dda98fae8e2f23a6180 May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: X-User-Name: admin May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: method: > May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: exception: Flavor 451 could not be found. May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: action_args: {'id': '451'} May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:27:13.818523 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:13.819512 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: ERROR nova.api.openstack.wsgi May 12 09:27:13.820823 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-2d5ceb15-56b6-420a-9084-d3bb2ae11090 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:27:13.822084 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-2d5ceb15-56b6-420a-9084-d3bb2ae11090 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011503 May 12 09:27:13.822084 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 12 09:27:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 09:27:14.698252 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:14.699295 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 12 09:27:14.699692 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:27:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:27:14.888436 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-6b7a8dc9-11b3-4ffe-8c9b-2bd6b29889fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:27:14.906108 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-6b7a8dc9-11b3-4ffe-8c9b-2bd6b29889fa admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069912 May 12 09:27:14.906642 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Thu May 12 09:27:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:27:15.804074 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:15.805088 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 12 09:27:15.805490 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:27:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:27:16.001625 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-bb12aac9-7876-4081-bf74-fc5e895fab5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:27:16.023792 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-bb12aac9-7876-4081-bf74-fc5e895fab5f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.082107 May 12 09:27:16.024371 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Thu May 12 09:27:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:27:17.017625 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:17.018659 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 12 09:27:17.019063 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:27:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:27:17.209556 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-6aa36721-a8c3-45f9-8072-4192046cbea4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:27:17.226542 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-6aa36721-a8c3-45f9-8072-4192046cbea4 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068138 May 12 09:27:17.227088 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Thu May 12 09:27:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:27:18.119813 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:18.120822 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 12 09:27:18.121253 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:27:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:27:18.308996 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-3e420727-fd2a-4539-9e4f-dbb0ac96387b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:27:18.326090 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-3e420727-fd2a-4539-9e4f-dbb0ac96387b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067783 May 12 09:27:18.326638 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Thu May 12 09:27:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:27:19.237657 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:19.238690 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 12 09:27:19.239087 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:27:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:27:19.427090 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-5a60e708-66b1-4d25-8c84-287eb6cbc26c admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:27:19.445767 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-5a60e708-66b1-4d25-8c84-287eb6cbc26c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069937 May 12 09:27:19.446505 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Thu May 12 09:27:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:28:21.136382 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:28:21.137407 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-37629a0a-1144-41a1-9a95-b2326e369713 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 12 09:28:21.137844 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Thu May 12 09:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:28:21.195960 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-cbfba48a-24b2-4bd5-bf9f-068aa6f77b8a admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:28:21.214700 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-cbfba48a-24b2-4bd5-bf9f-068aa6f77b8a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070867 May 12 09:28:21.215233 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Thu May 12 09:28:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:28:21.237648 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-e2406276-6a52-40d1-83df-645d35f533af admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:28:21.245132 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-e2406276-6a52-40d1-83df-645d35f533af admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012194 May 12 09:28:21.245655 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Thu May 12 09:28:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:28:21.257282 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-439c52ee-d6f7-4e0b-a9fc-c2460290281b admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:28:21.264664 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-439c52ee-d6f7-4e0b-a9fc-c2460290281b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011096 May 12 09:28:21.265172 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Thu May 12 09:28:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:28:21.275777 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:28:21.282954 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010665 May 12 09:28:21.283470 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Thu May 12 09:28:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:28:21.293841 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-deaa17e9-119a-496c-ab90-a4f4e17b0ad5 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:28:21.301435 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-deaa17e9-119a-496c-ab90-a4f4e17b0ad5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010904 May 12 09:28:21.301977 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Thu May 12 09:28:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:31:40.759236 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:31:40.760314 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001795 May 12 09:31:40.761307 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:31:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:31:41.151224 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-d95c7900-a3b0-492e-81a5-d7055e4a10de admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:31:41.152377 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:31:41.152377 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: warnings.warn(msg) May 12 09:31:41.153558 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-d95c7900-a3b0-492e-81a5-d7055e4a10de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:31:41.154024 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-d95c7900-a3b0-492e-81a5-d7055e4a10de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:31:41.154806 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-d95c7900-a3b0-492e-81a5-d7055e4a10de admin admin] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:31:41.155234 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-d95c7900-a3b0-492e-81a5-d7055e4a10de admin admin] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:31:41.188701 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-d95c7900-a3b0-492e-81a5-d7055e4a10de admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.274897 May 12 09:31:41.189199 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 12 09:31:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:31:42.114913 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:31:42.115922 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 12 09:31:42.116321 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:31:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:31:42.309342 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-a837a90c-f563-4d96-8edd-cc7d3e4cc9e7 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:31:42.310534 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:31:42.310534 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: warnings.warn(msg) May 12 09:31:42.311776 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-a837a90c-f563-4d96-8edd-cc7d3e4cc9e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:31:42.312205 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-a837a90c-f563-4d96-8edd-cc7d3e4cc9e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:31:42.313006 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-a837a90c-f563-4d96-8edd-cc7d3e4cc9e7 admin admin] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:31:42.313425 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-a837a90c-f563-4d96-8edd-cc7d3e4cc9e7 admin admin] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:31:42.332636 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-a837a90c-f563-4d96-8edd-cc7d3e4cc9e7 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075515 May 12 09:31:42.333176 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 12 09:31:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:31:53.678064 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:31:53.679079 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 May 12 09:31:53.679487 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:31:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:31:53.869500 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-ce41da27-5708-494f-8e02-e7768e4f4b84 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:31:53.870683 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:31:53.870683 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: warnings.warn(msg) May 12 09:31:53.871849 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-ce41da27-5708-494f-8e02-e7768e4f4b84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:31:53.872289 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-ce41da27-5708-494f-8e02-e7768e4f4b84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:31:53.873067 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-ce41da27-5708-494f-8e02-e7768e4f4b84 admin admin] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:31:53.873494 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-ce41da27-5708-494f-8e02-e7768e4f4b84 admin admin] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:31:53.897945 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-ce41da27-5708-494f-8e02-e7768e4f4b84 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079468 May 12 09:31:53.898429 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 12 09:31:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:31:54.811725 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: DEBUG nova.api.openstack.wsgi [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] Calling method '>' {{(pid=102536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:31:54.812729 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: INFO nova.api.openstack.requestlog [None req-9e9d5bd3-fd50-4771-b4be-d562e7df9d32 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 12 09:31:54.813130 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: [pid: 102536|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Thu May 12 09:31:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:31:55.001272 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG nova.api.openstack.wsgi [None req-086c53c5-4c25-4a80-8716-8805372a0945 admin admin] Calling method '>' {{(pid=102535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:31:55.002475 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 09:31:55.002475 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: warnings.warn(msg) May 12 09:31:55.003824 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-086c53c5-4c25-4a80-8716-8805372a0945 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:31:55.004263 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-086c53c5-4c25-4a80-8716-8805372a0945 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:31:55.005047 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-086c53c5-4c25-4a80-8716-8805372a0945 admin admin] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:31:55.005469 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: DEBUG oslo_concurrency.lockutils [None req-086c53c5-4c25-4a80-8716-8805372a0945 admin admin] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:31:55.028775 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: INFO nova.api.openstack.requestlog [None req-086c53c5-4c25-4a80-8716-8805372a0945 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076850 May 12 09:31:55.029256 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: [pid: 102535|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Thu May 12 09:31:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:32:54.432599 dv-cinder-837699-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 09:32:54.433096 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: Thu May 12 09:32:54 2022 - graceful shutdown triggered... May 12 09:32:54.433520 dv-cinder-837699-5-iscsi devstack@n-api.service[102535]: Gracefully killing worker 1 (pid: 102535)... May 12 09:32:54.433886 dv-cinder-837699-5-iscsi devstack@n-api.service[102536]: Gracefully killing worker 2 (pid: 102536)... May 12 09:32:55.433913 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: worker 1 buried after 1 seconds May 12 09:32:55.434472 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: worker 2 buried after 1 seconds May 12 09:32:55.434472 dv-cinder-837699-5-iscsi devstack@n-api.service[102534]: goodbye to uWSGI. May 12 09:32:55.435537 dv-cinder-837699-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 09:32:55.436098 dv-cinder-837699-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 09:32:55.438815 dv-cinder-837699-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 09:32:55.459356 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 09:32:55 2022] *** May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: nodename: dv-cinder-837699-5-iscsi May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: machine: x86_64 May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: clock source: unix May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: pcre jit disabled May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: detected number of CPU cores: 4 May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: current working directory: / May 12 09:32:55.480948 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: detected binary path: /usr/bin/uwsgi-core May 12 09:32:55.481736 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: your processes number limit is 47680 May 12 09:32:55.481736 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: your memory page size is 4096 bytes May 12 09:32:55.481736 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: detected max file descriptor number: 2048 May 12 09:32:55.481736 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: lock engine: pthread robust mutexes May 12 09:32:55.481736 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: thunder lock: enabled May 12 09:32:55.481736 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 09:32:55.481736 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 09:32:55.527264 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: Python main interpreter initialized at 0x5631ad4b89c0 May 12 09:32:55.527264 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: python threads support enabled May 12 09:32:55.527264 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: your server socket listen backlog is limited to 100 connections May 12 09:32:55.527264 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: your mercy for graceful operations on workers is 90 seconds May 12 09:32:55.527729 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: mapped 403077 bytes (393 KB) for 2 cores May 12 09:32:55.527729 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: *** Operational MODE: preforking *** May 12 09:32:55.527959 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: *** uWSGI is running in multiple interpreter mode *** May 12 09:32:55.527959 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: spawned uWSGI master process (pid: 123499) May 12 09:32:55.528158 dv-cinder-837699-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 09:32:55.530022 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: spawned uWSGI worker 1 (pid: 123509, cores: 1) May 12 09:32:55.530022 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: spawned uWSGI worker 2 (pid: 123510, cores: 1) May 12 09:32:55.530022 dv-cinder-837699-5-iscsi devstack@n-api.service[123499]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 09:32:56.750592 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 09:32:56.760954 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 12 09:32:57.549051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:32:57.549051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: from cryptography.utils import int_from_bytes May 12 09:32:57.549379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:32:57.549379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: from cryptography.utils import int_from_bytes May 12 09:32:57.563719 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:32:57.563719 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: from cryptography.utils import int_from_bytes May 12 09:32:57.564042 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 09:32:57.564042 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: from cryptography.utils import int_from_bytes May 12 09:33:00.018776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 09:33:00.019352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 09:33:00.019647 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 09:33:00.019926 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 09:33:00.020186 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 09:33:00.020574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.020904 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.021227 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.021548 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.021881 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.022212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.022540 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.022863 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.023198 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.023462 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.023780 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.024105 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-5-iscsi {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.024427 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.024735 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.025614 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.025963 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.026276 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.026602 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.026911 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.027410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.028886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.028886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.028886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.028886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.029221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.029453 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.029714 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.030051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.030380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.030702 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.031110 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-5-iscsi {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.031422 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.031741 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.032068 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.032473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.032780 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.033098 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.033409 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.033731 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.034064 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.034292 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 09:33:00.034715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.034810 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 09:33:00.034897 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.035109 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.035345 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 09:33:00.035562 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.035787 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 09:33:00.035980 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.036165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 09:33:00.036354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.036514 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.036661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.036847 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.037003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.037149 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.037300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.037492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.037653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.037653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.038065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.038212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.038355 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.038513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.038677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.038886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.039036 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.039191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.039347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.039509 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.039670 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.039823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.039969 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.040134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.040294 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837699-5-iscsi {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.040461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.040625 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.040799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.040956 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.041129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.041285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.041470 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.041633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.041786 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.041970 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.042155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.042312 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.042494 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.042651 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.042812 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.042812 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.043091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.043301 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.043473 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.045227 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.045647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.045810 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.046011 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.046166 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.046311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.046472 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.046638 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.046785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.046943 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.047090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.047242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.047397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.047550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.047704 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.047857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.048004 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.048156 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.048312 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.048469 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837699-5-iscsi {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.048622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.048766 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.048933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.049094 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.049250 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.049395 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.049550 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.049695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.049848 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.050036 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.050186 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.050331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.050485 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.050637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.050797 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.050797 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.051097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.051252 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.051404 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.051556 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.051723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.051870 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.052020 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.052174 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.052327 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.052487 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.052487 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.052795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.052949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.053103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.053263 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.053408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.053565 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.053718 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.053875 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.054061 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.054723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.054885 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.055041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.055403 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.055580 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.055734 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.055888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.056067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.056710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.056863 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.057009 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.057384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.057541 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.057697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.057697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.058015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.058181 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.058331 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.058645 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.058817 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.058912 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.058999 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059163 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059410 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059499 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059499 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059660 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059660 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059821 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.059908 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060002 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060096 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060182 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060273 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060364 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060450 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060542 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060628 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060871 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.060971 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.061066 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.061158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.061250 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.061343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.061435 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.061596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.061685 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.061770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.061861 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062121 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062212 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062306 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062572 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062659 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062743 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.062927 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063018 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063111 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063202 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063296 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063382 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063568 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063753 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063851 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.063943 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.064035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.064128 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.064225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.064334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.064764 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.064864 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.064950 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.065044 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.065136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.065223 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.065339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.065440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.065525 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.065525 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.065688 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.065842 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.066009 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.066184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.066293 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.066501 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.066596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.066818 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.066921 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.067133 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.067226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.067444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.067544 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.067755 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.067855 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.068064 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.068163 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.068376 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.068469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.068691 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.068791 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.069017 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.069117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.069334 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.069436 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.069649 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.069742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.069986 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.070096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.070303 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.070405 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.070617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.070718 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.070944 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.071039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.071256 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.071356 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.071567 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.071666 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.072463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.072566 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.072782 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.072877 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.073098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.073194 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.073427 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.073527 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.073739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.073838 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.074084 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.074179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.074398 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.074504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.074826 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.074938 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.075034 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.075134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.075326 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.075420 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.075641 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.075742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.075959 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.076094 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.076271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.076375 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.076584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.076684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.076892 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.076999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.077202 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.077313 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.077510 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.077603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.077820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.078010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.078154 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.078252 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.078481 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.078582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.078796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.078897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.079111 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.079236 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.079422 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.079516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.079730 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.079822 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.080041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.080136 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 09:33:00.080385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.080478 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.080724 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.081077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.081399 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.081531 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.081740 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.081916 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.082118 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.082236 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.082446 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.082537 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.082766 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.082857 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.083088 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.083181 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.083422 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.083512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.083744 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.083830 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.084064 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.084156 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.084382 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.084465 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.084698 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.085969 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.086265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.086358 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.086439 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.086524 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.086609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.086685 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.086775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.086851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.086932 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.087014 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.087097 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.087179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.087318 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.087436 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.087513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.087586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.087666 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.087915 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.088000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.088075 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.088280 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.088412 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.088732 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.088858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.089053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.089161 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.089368 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.089475 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.089684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.089799 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.090023 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.090124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.090344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.090451 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.090656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.090769 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.090972 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.091072 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.091309 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.091416 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.091626 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.091748 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.091938 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.092035 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.092255 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.092355 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.092577 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.092673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.092891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.092992 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.093197 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.093305 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.093510 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.093612 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.093821 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.093931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.094154 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.094238 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.097522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.097651 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.097745 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.097833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.097983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098062 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098164 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098252 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098421 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098506 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098600 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098682 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098763 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098919 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.098992 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099232 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099386 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099466 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099549 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099633 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099715 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099877 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.099957 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100039 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100114 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100258 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100338 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100420 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100495 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100656 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100730 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100887 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.100968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.101049 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.101143 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.101218 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.101297 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.101479 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.101575 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.101861 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.102007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.102090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.102171 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.102442 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.102563 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.102703 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.102805 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.103052 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.103156 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.103369 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.103471 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.103695 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.103791 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.104004 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.104113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.104324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.104425 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.104647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.104754 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.104978 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.105082 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.105293 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.105387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.105613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.105714 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.106089 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.106213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.106305 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.106391 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.106567 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.106662 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.106880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.106975 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.107192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.107286 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.107504 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.107610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.107825 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.107939 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.108135 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.108237 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.108445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.108544 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.108755 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.108850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.109065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.109166 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.109381 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.109483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.109694 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.109796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.110535 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.110629 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.110724 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.110820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.110908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.111000 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.111000 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.111165 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.111264 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.111351 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.111562 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.111691 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.111869 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.111971 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.112182 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.112291 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.112489 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.112593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.112801 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.112901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.113108 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.113215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.113415 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.113521 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.113736 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.113863 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.114075 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.114184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.114390 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.114495 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.114701 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.114808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.115007 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.115105 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.115323 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.115419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.115633 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.115858 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.116009 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.116166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.116303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.116453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.116601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.116751 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.116901 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.117048 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.117194 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.117290 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.117483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.117745 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.118003 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.118114 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.118345 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.118441 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.119185 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.119288 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.119496 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.119591 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.119799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.119903 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.120106 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.120215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.120408 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.120503 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.120750 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.120844 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.121063 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.121161 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.121367 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.121469 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.121759 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.121866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.122026 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.122123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.122341 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.122443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.122657 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.122781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.122994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.123097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.123279 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.123370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.123601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.123699 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.123918 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.124001 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.124225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.124307 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.124537 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.124634 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.124847 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.124939 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.125158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.125250 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.125468 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.125561 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.125781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.125871 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.126113 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.126207 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.126424 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.126607 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.126734 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.126875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.127026 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.127119 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.127334 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.127492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.127654 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.127758 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.128029 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.128238 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.128398 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.128571 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.128728 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.128887 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.128988 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.129205 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.129319 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.129522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.129622 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.129839 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.129964 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.130226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.130322 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.130574 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.130710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.130850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.130930 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.131170 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.131274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.131486 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.131588 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.131798 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.131920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.132099 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.132191 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.132411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.132503 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.132720 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.132852 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.133068 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.133173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.133329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.133449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.133642 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.134058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.134286 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.135095 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.135227 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.135493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.135815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.136131 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.136443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.139916 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140277 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140377 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140467 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140564 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.140931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141024 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141120 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141216 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141568 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141652 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141750 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.141837 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143174 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143282 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143362 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143437 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143526 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143602 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143675 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143747 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143835 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.143928 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144189 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144189 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144366 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144605 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144800 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.144981 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145083 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145350 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145435 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145522 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145839 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.145945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146052 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146141 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146324 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146406 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146487 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146587 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146670 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146755 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146829 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146901 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.146994 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.147085 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.147896 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148024 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148126 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148296 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148456 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148544 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148627 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.148880 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.149527 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.149642 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.149741 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.149838 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.150016 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.150125 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.150350 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.150455 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.150539 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.150636 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.150724 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.151363 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.151487 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.151581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.151679 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.151763 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.151845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.151939 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.152028 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.152384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.152512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.152603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.152677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.152910 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.153052 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.153223 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.153370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.153642 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.153833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.153971 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.154188 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.154283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.154505 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.154608 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.154833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.154938 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.155155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.155325 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.155465 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.155568 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.155783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.155886 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.156090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.156200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.156398 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.156500 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.156704 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.156802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.157015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.157123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.157323 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.157437 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.157631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.157745 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.157954 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.158067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.158261 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.158363 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.158564 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.158658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.158891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.159049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.159203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.159311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.159507 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.159650 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.159796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.159895 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.160102 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.160206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.160448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.160549 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.160756 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.160850 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.161075 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.161180 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.161385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.161487 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.161706 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.161802 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.162055 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.162163 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.162369 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.162476 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.162676 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.162777 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.162993 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.163086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.163303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.163451 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.163610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.163710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.163924 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.164017 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.164231 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.164339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.164537 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.164637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.164844 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.164937 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.165151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.165254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.165464 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.165622 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.165828 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.166019 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.166176 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.166279 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.166499 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.166594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.166824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.166924 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.167129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.167233 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.167444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.167579 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.167756 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.167864 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.168063 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.168157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.168373 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.168469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.168681 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.168783 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.168990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.169086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.169303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.169409 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.169612 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.169741 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.169943 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.170049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.170252 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.170349 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.170559 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.170667 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.170869 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.170969 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.171178 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.171272 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.171483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.171587 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.171789 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.171889 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.172100 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.172202 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.172402 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.172507 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.172711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.172805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.173015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.173107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.173326 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.173420 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.173630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.173723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.173969 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.174077 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.174284 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.174389 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.174592 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.174694 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.174942 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.175048 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.175254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.175350 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.175580 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.175680 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.175903 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.175998 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.176221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.176323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.176529 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.176631 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.176848 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.176942 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.177164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.177266 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.177489 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.177640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.177800 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.177943 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.178150 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.178259 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.178454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.178581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.178766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.178917 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.179077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.179178 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.179389 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.179536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.179693 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.179827 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.179997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.180127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.180318 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.180437 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.180622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.180728 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.180943 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.181045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.181800 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.182091 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.182204 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.182736 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183059 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183196 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183295 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183486 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183764 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183857 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.183993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.184151 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.184312 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.184475 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.184630 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.184797 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.184946 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.185122 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.185262 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.185408 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.185572 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.185722 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.185889 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.186078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.186226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.186404 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.186538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.186719 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.186868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.187022 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.187278 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.187420 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.187572 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.187670 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.187951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.188066 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.188265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.188431 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.188684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.188798 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.189001 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.189145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.189324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.189491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.189636 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.189814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.189972 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.190157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.190300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.190471 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.190607 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.190789 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.190912 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.191104 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.191226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.191426 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.191522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.191749 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.191851 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.192058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.192154 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.192432 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.192535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.192743 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.192838 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.193053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.193148 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.193361 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.193464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.193667 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.193763 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.193991 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.194103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.194308 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.194411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.194611 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.194705 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.194933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.195037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.195243 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.195336 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.195555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.195685 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.195881 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.196009 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.196186 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.196314 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.196508 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.196633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.196868 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.197669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.197763 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.197998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.198108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.198381 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.198516 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.198775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.198896 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.199089 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.199195 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.199412 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.199516 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.199745 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.199865 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.200074 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.200167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.200386 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.200481 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.200707 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.200800 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.201026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.201129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.201340 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.201441 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.201659 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.201760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.202002 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.202100 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.202306 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.202408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.202610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.202712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.202920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.203027 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.203225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.203328 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.203530 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.203623 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.203836 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.203967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.204143 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.204272 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.204603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.204712 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.204925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.205053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.205252 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.205358 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.205586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.205731 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.205979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.206092 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.206231 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.206326 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.206548 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.206642 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.206852 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.206953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.207157 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.207258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.207461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.207558 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.207784 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.207892 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.208096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.208197 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.208410 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.208514 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.208727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.208830 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.209039 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.209154 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.209352 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.209448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.209661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.209825 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.210000 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.210099 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.210407 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.210539 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.210636 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.210725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.210920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.211022 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.211235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.211343 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.211550 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.211653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.211866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.211960 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.212179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.212284 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.212512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.212615 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.212820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.212920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.213129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.213237 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.213444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.213537 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.213776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.214034 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.214148 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.214369 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.214507 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.214688 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.214784 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.215003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.215112 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.215317 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.215412 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.215632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.215735 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.215951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.216096 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.216265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.216367 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.216578 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.216673 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.216892 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.217001 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.217205 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.217366 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.217528 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.217629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.217840 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.217973 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.218177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.218284 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.218488 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.218591 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.218802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.218935 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.219119 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.219256 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.219429 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.219604 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.219736 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.219926 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.220064 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.220289 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.220386 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.220605 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.220697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.220915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.221020 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.221231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.221324 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.221549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.221644 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.221865 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.222023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.222200 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.222296 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.222511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.222614 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.222825 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.222920 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.223141 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.223245 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.223455 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.223550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.223765 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.223868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.224080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.224183 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.224397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.224490 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.224717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.224807 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.225039 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.225135 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.225358 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.225459 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.225675 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.225768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.226018 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.226118 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.226340 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.226437 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.226660 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.226911 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.227016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.227230 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.227333 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.227564 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.227713 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.227891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.228022 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.228249 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.228475 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.228569 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.228810 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.228905 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.229138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.229234 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.229460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.229560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.229771 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.229880 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.230110 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.230208 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.230422 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.230552 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.230729 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.230839 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.231043 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.231143 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.231352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.231445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.231657 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.231766 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.231979 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.232074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.232289 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.232390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.232624 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.232826 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.232965 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.233177 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.233272 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.233494 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.233598 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.233819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.233959 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.234170 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.234298 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.234490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.234593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.234799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.234903 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.235123 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.235224 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.235430 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.235526 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.235742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.235836 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.236058 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.236153 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.236370 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.236465 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.236677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.236771 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.236982 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.237086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.237294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.237391 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.237603 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.237698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.237961 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.238080 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.238238 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.238335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.238543 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.238640 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.238870 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.238980 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.239177 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.239279 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.239482 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.239579 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.239786 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.239895 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.240095 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.240204 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.240398 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.240500 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.240701 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.240985 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.241084 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.241295 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.241388 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.241605 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.241709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.241921 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.242041 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.242236 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.242331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.242538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.242647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.242850 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.242945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.243152 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.243255 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.243461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.243565 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.244357 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.244628 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.244722 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.244952 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.245058 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.245267 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.245376 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.245579 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.245679 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.245910 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.246020 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.246240 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.246341 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.246550 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.246650 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.246860 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.246967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.247176 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.247270 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.247511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.247719 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.248046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.248150 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.248380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.248484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.248705 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.248835 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.249920 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250466 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250573 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250573 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250573 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250868 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.250980 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.251177 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.251284 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.251486 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.251581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.251794 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.251890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.252102 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.252207 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.252412 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.252508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.252722 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.252818 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.253030 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.253127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.253337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.253439 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.253644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.253739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.253975 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.254074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.254285 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.254393 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.254601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.254703 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.254941 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.255045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.255258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.255351 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.255571 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.255666 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.255890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.255986 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.256203 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.256297 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.256511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.256613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.256821 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.256922 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.257127 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.257221 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.257436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.257544 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.257744 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.257845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.258095 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.258202 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.258407 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.258510 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.258712 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.259102 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.259383 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.259969 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.260251 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.260393 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.260557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.260721 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.260879 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.261080 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.261187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.261414 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.261516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.261742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.261843 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.262124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.262231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.262445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.262546 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.262757 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.262851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.263085 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.263189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.263414 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.263514 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.263738 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.263831 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.264063 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.264159 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.264368 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.264637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.264740 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.264962 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.265065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.265273 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.265368 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.265595 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.265689 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.265949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.266062 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.266229 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.266325 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.266533 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.266699 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.266842 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.267023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.267156 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.267357 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.267487 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.267679 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.267810 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.267999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.268120 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.268311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.268437 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.268613 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.268862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.268995 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.269116 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.269230 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.269354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.269493 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.269628 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.269835 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.269986 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.270166 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.270295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.270476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.270604 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.270780 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.270900 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.271084 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.271212 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.271388 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.271529 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.271692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.271819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.271997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.272136 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.272327 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.272466 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.272661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.272760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.272976 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.273071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.273292 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.273394 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.273601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.273701 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.273931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.274041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.274249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.274345 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.274572 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.274675 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.274909 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.275021 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.275231 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.275329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.275541 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.275643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.275877 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.275981 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.276189 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.276285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.276502 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.276598 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.276815 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.276911 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.277128 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.277223 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.277439 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.277541 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.277750 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.277859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.278102 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.278200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.278431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.278534 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.278741 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.278837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.279066 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.279210 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.279384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.279492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.279707 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.279810 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.280024 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.280127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.280337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.280445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.280656 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.280790 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.280967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.281061 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.281278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.281404 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.281595 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.281698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.281917 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.282012 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.282239 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.282342 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.282548 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.282651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.282865 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.282968 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.283177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.283273 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.283485 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.283580 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.283794 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.283888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.284103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.284199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.284417 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.284511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.284723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.284818 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.285031 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.285134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.285338 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.285434 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.285646 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.285749 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.285975 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.286075 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.286287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.286382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.286555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123509) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 09:33:00.286665 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.286894 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.287205 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.287513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.287823 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.288130 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.288465 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.288802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.289123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.289456 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.289773 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.290125 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.290442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.290771 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.291099 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.291419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.291737 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.292075 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.292391 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.292709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.293025 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.293341 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.293656 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.293996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.294334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.294667 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.294980 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.295312 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.295635 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.295964 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.296289 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.296610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.296947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.297266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.297584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.297949 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.298242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.298563 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.298885 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.299205 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.299543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.299874 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.300204 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.300536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.300890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.301209 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.301560 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.301913 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.302233 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.302549 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.302859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 09:33:00.303109 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123510) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 09:33:00.311811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_db.sqlalchemy.engines [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:33:00.327086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_db.sqlalchemy.engines [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:33:00.375107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.context [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13a725-2629-4ace-99a6-21ba5d823ec1(cell1) {{(pid=123509) load_cells /opt/stack/nova/nova/context.py:464}} May 12 09:33:00.379444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:00.381022 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:00.381859 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:00.384045 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:00.390327 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.context [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1a13a725-2629-4ace-99a6-21ba5d823ec1(cell1) {{(pid=123510) load_cells /opt/stack/nova/nova/context.py:464}} May 12 09:33:00.394729 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:00.395839 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_db.sqlalchemy.engines [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:33:00.396342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:00.397179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:00.398185 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_db.sqlalchemy.engines [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:33:00.399178 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:00.412340 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_db.sqlalchemy.engines [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:33:00.414223 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_db.sqlalchemy.engines [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:33:00.555389 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_db.sqlalchemy.engines [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123509) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:33:00.574488 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_db.sqlalchemy.engines [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123510) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 09:33:00.884341 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: WARNING keystonemiddleware.auth_token [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 09:33:00.892341 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: WARNING keystonemiddleware.auth_token [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 09:33:00.899014 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: WARNING keystonemiddleware.auth_token [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 09:33:00.907202 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: WARNING keystonemiddleware.auth_token [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 09:33:01.244206 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: WARNING keystonemiddleware.auth_token [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 09:33:01.250375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: WARNING keystonemiddleware.auth_token [None req-126c597e-7cbe-4656-bdd8-f7685ec33d9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 09:33:01.255673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5631ad4b89c0 pid: 123509 (default app) May 12 09:33:01.265512 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: WARNING keystonemiddleware.auth_token [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 09:33:01.271848 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: WARNING keystonemiddleware.auth_token [None req-8a099042-24ad-42cb-ad45-1d856cf2e1d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 09:33:01.277677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5631ad4b89c0 pid: 123510 (default app) May 12 09:33:43.439725 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2a22e5c9-edad-4a1c-9ba7-bb7381676d20 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Action: 'create', calling method: .version_select at 0x7f87280ad280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-284038175"}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:33:45.070902 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e1d435e9-098d-4f98-a556-dafffd337e6f tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Action: 'create', calling method: .version_select at 0x7f87280ac280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1841610451", "metadata": {"Type": "work"}}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e1d435e9-098d-4f98-a556-dafffd337e6f tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Request method failure captured: May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 122 May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR3QW6NLPs9miTPHvdUPpbs_NXX6IvWmZJmT39T_2paWGxtgQ5f1JaZgqEwT7ae5Yu-Zjm1KGIvgG5NVIcV6vUKPUco3qUlKqM8T7WGJNtjs_EQbrFc_n2Vr_CNlZUqb9FSVI9bpcpLU9CSrE6bhGdAHB5CfgtisVDOsNav6Ro99wo May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:33:45.104581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e24c3b4bb7dd44c68884a021507f7e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}] May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesNegativeTest-1828849117 May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: d2a7bfec6c8140e2bd633d6184ad4716 May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1841610451", "metadata": {"Type": "work"}}} May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: May 12 09:33:45.106354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1841610451', 'metadata': {'Type': 'work'}}}} May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise error May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi '#$%' May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:33:45.107323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 09:33:45.108717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 09:33:45.109925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 12 09:33:45.109925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.109925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e1d435e9-098d-4f98-a556-dafffd337e6f tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:33:45.109925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e1d435e9-098d-4f98-a556-dafffd337e6f tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.914920 May 12 09:33:45.109925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1155 bytes} [Thu May 12 09:33:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1918 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 09:33:45.116693 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-47103fd0-31ce-4ab8-82e6-09807066ca3a tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Action: 'create', calling method: .version_select at 0x7f8727f415e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1396753183", "metadata": {"Type": "work"}}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-47103fd0-31ce-4ab8-82e6-09807066ca3a tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Request method failure captured: May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 120 May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR3QW6NLPs9miTPHvdUPpbs_NXX6IvWmZJmT39T_2paWGxtgQ5f1JaZgqEwT7ae5Yu-Zjm1KGIvgG5NVIcV6vUKPUco3qUlKqM8T7WGJNtjs_EQbrFc_n2Vr_CNlZUqb9FSVI9bpcpLU9CSrE6bhGdAHB5CfgtisVDOsNav6Ro99wo May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:33:45.120530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e24c3b4bb7dd44c68884a021507f7e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}] May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesNegativeTest-1828849117 May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: d2a7bfec6c8140e2bd633d6184ad4716 May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1396753183", "metadata": {"Type": "work"}}} May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: May 12 09:33:45.121926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1396753183', 'metadata': {'Type': 'work'}}}} May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise error May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi '0' May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:33:45.122742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 09:33:45.124113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 09:33:45.125266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 12 09:33:45.125266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.125266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-47103fd0-31ce-4ab8-82e6-09807066ca3a tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:33:45.125266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-47103fd0-31ce-4ab8-82e6-09807066ca3a tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009839 May 12 09:33:45.128164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 2/2] 10.222.0.60 () {60 vars in 1155 bytes} [Thu May 12 09:33:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 09:33:45.133509 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2df5a45b-2794-440f-85cb-5d98707c3acf tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Action: 'create', calling method: .version_select at 0x7f87280ac5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1778045593", "metadata": {"Type": "work"}}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2df5a45b-2794-440f-85cb-5d98707c3acf tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Request method failure captured: May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 119 May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR3QW6NLPs9miTPHvdUPpbs_NXX6IvWmZJmT39T_2paWGxtgQ5f1JaZgqEwT7ae5Yu-Zjm1KGIvgG5NVIcV6vUKPUco3qUlKqM8T7WGJNtjs_EQbrFc_n2Vr_CNlZUqb9FSVI9bpcpLU9CSrE6bhGdAHB5CfgtisVDOsNav6Ro99wo May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:33:45.140780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e24c3b4bb7dd44c68884a021507f7e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}] May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesNegativeTest-1828849117 May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: d2a7bfec6c8140e2bd633d6184ad4716 May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1778045593", "metadata": {"Type": "work"}}} May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: May 12 09:33:45.142387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1778045593', 'metadata': {'Type': 'work'}}}} May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise error May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi On instance['volume']: May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi '' May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:33:45.143172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 12 09:33:45.144493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 12 09:33:45.145616 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 12 09:33:45.145616 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:45.152502 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2df5a45b-2794-440f-85cb-5d98707c3acf tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:33:45.153640 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2df5a45b-2794-440f-85cb-5d98707c3acf tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024067 May 12 09:33:45.154430 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 3/3] 10.222.0.60 () {60 vars in 1155 bytes} [Thu May 12 09:33:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 09:33:45.164190 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3bfe5f59-fa07-4e79-ac23-c2cedddc52fa tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Calling method '.version_select at 0x7f8727f60310>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:46.004982 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-3bfe5f59-fa07-4e79-ac23-c2cedddc52fa tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] HTTP exception thrown: Volume tempest-invalid-1297445356 could not be found. May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3bfe5f59-fa07-4e79-ac23-c2cedddc52fa tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Request method failure captured: May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1297445356 HTTP/1.1 May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR3QW6NLPs9miTPHvdUPpbs_NXX6IvWmZJmT39T_2paWGxtgQ5f1JaZgqEwT7ae5Yu-Zjm1KGIvgG5NVIcV6vUKPUco3qUlKqM8T7WGJNtjs_EQbrFc_n2Vr_CNlZUqb9FSVI9bpcpLU9CSrE6bhGdAHB5CfgtisVDOsNav6Ro99wo May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:33:46.011021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e24c3b4bb7dd44c68884a021507f7e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}] May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesNegativeTest-1828849117 May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: d2a7bfec6c8140e2bd633d6184ad4716 May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Volume tempest-invalid-1297445356 could not be found. May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'tempest-invalid-1297445356'} May 12 09:33:46.012814 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1297445356 could not be found. (HTTP 404) (Request-ID: req-f9f52548-a1a6-4abd-8f59-71f9b3739ab6) May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:46.013796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 09:33:46.014997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1297445356 could not be found. May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:33:46.016185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1297445356 could not be found. May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1297445356 could not be found. May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3bfe5f59-fa07-4e79-ac23-c2cedddc52fa tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Returning 404 to user: Volume tempest-invalid-1297445356 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3bfe5f59-fa07-4e79-ac23-c2cedddc52fa tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1297445356" status: 404 len: 99 microversion: 2.1 time: 0.852950 May 12 09:33:46.017371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 4/4] 10.222.0.60 () {58 vars in 1217 bytes} [Thu May 12 09:33:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1297445356 => generated 99 bytes in 855 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 12 09:33:46.036230 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b18d7938-f287-490b-981e-bc5321d13071 tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013387 May 12 09:33:46.037400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 5/5] 10.222.0.60 () {58 vars in 1139 bytes} [Thu May 12 09:33:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 09:33:46.053027 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1e157ff0-59c8-43a6-ac29-bb57d7059239 tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009658 May 12 09:33:46.058425 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 6/6] 10.222.0.60 () {58 vars in 1136 bytes} [Thu May 12 09:33:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 12 09:33:46.077278 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7195740c-03b8-4160-919d-49ba3272d983 tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Calling method '.version_select at 0x7f8727e88160>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:46.100463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2a22e5c9-edad-4a1c-9ba7-bb7381676d20 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.890807 May 12 09:33:46.102525 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 1/7] 10.222.0.60 () {60 vars in 1154 bytes} [Thu May 12 09:33:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3896 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 09:33:46.118575 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e2772e19-7538-4f5d-b78f-223088d7c3ba tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727f06280>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:46.310416 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-7195740c-03b8-4160-919d-49ba3272d983 tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] HTTP exception thrown: Volume 956d55ea-500b-492a-bef3-c45456379594 could not be found. May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7195740c-03b8-4160-919d-49ba3272d983 tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Request method failure captured: May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: DELETE /compute/v2.1/os-volumes/956d55ea-500b-492a-bef3-c45456379594 HTTP/1.1 May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR3QW6NLPs9miTPHvdUPpbs_NXX6IvWmZJmT39T_2paWGxtgQ5f1JaZgqEwT7ae5Yu-Zjm1KGIvgG5NVIcV6vUKPUco3qUlKqM8T7WGJNtjs_EQbrFc_n2Vr_CNlZUqb9FSVI9bpcpLU9CSrE6bhGdAHB5CfgtisVDOsNav6Ro99wo May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:33:46.312931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e24c3b4bb7dd44c68884a021507f7e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}] May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesNegativeTest-1828849117 May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: d2a7bfec6c8140e2bd633d6184ad4716 May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Volume 956d55ea-500b-492a-bef3-c45456379594 could not be found. May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '956d55ea-500b-492a-bef3-c45456379594'} May 12 09:33:46.314390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 956d55ea-500b-492a-bef3-c45456379594 could not be found. (HTTP 404) (Request-ID: req-50ec568a-c95c-4596-b562-d1a2bbafa4e4) May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:46.315162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 09:33:46.316361 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 956d55ea-500b-492a-bef3-c45456379594 could not be found. May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 09:33:46.317460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 956d55ea-500b-492a-bef3-c45456379594 could not be found. May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 956d55ea-500b-492a-bef3-c45456379594 could not be found. May 12 09:33:46.321271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:46.323453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7195740c-03b8-4160-919d-49ba3272d983 tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Returning 404 to user: Volume 956d55ea-500b-492a-bef3-c45456379594 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:33:46.324733 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7195740c-03b8-4160-919d-49ba3272d983 tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/956d55ea-500b-492a-bef3-c45456379594" status: 404 len: 109 microversion: 2.1 time: 0.263690 May 12 09:33:46.330371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 7/8] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:33:46 2022] DELETE /compute/v2.1/os-volumes/956d55ea-500b-492a-bef3-c45456379594 => generated 109 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:33:46.336875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a77e3aae-53a8-4d6e-9cb7-be8e31e80f9f tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Calling method '.version_select at 0x7f8727e88280>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:46.416055 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e2772e19-7538-4f5d-b78f-223088d7c3ba tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 200 len: 344 microversion: 2.1 time: 0.305768 May 12 09:33:46.416616 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 2/9] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:33:46 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 344 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:33:47.157134 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-a77e3aae-53a8-4d6e-9cb7-be8e31e80f9f tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] HTTP exception thrown: Volume dc207343-8cf7-468a-88ef-19288bc1bda5 could not be found. May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a77e3aae-53a8-4d6e-9cb7-be8e31e80f9f tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Request method failure captured: May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/os-volumes/dc207343-8cf7-468a-88ef-19288bc1bda5 HTTP/1.1 May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR3QW6NLPs9miTPHvdUPpbs_NXX6IvWmZJmT39T_2paWGxtgQ5f1JaZgqEwT7ae5Yu-Zjm1KGIvgG5NVIcV6vUKPUco3qUlKqM8T7WGJNtjs_EQbrFc_n2Vr_CNlZUqb9FSVI9bpcpLU9CSrE6bhGdAHB5CfgtisVDOsNav6Ro99wo May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:33:47.159360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e24c3b4bb7dd44c68884a021507f7e5e", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e24c3b4bb7dd44c68884a021507f7e5e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e24c3b4bb7dd44c68884a021507f7e5e"}]}] May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesNegativeTest-1828849117 May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: e24c3b4bb7dd44c68884a021507f7e5e May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesNegativeTest-1828849117 May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: d2a7bfec6c8140e2bd633d6184ad4716 May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesNegativeTest-1828849117-project May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Volume dc207343-8cf7-468a-88ef-19288bc1bda5 could not be found. May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'dc207343-8cf7-468a-88ef-19288bc1bda5'} May 12 09:33:47.161007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dc207343-8cf7-468a-88ef-19288bc1bda5 could not be found. (HTTP 404) (Request-ID: req-04b5e1be-3f6d-41ce-be43-2ed5ffd74a12) May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:47.162513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:33:47.163948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dc207343-8cf7-468a-88ef-19288bc1bda5 could not be found. May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 09:33:47.165850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dc207343-8cf7-468a-88ef-19288bc1bda5 could not be found. May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dc207343-8cf7-468a-88ef-19288bc1bda5 could not be found. May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a77e3aae-53a8-4d6e-9cb7-be8e31e80f9f tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] Returning 404 to user: Volume dc207343-8cf7-468a-88ef-19288bc1bda5 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:33:47.167323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a77e3aae-53a8-4d6e-9cb7-be8e31e80f9f tempest-VolumesNegativeTest-1828849117 tempest-VolumesNegativeTest-1828849117-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/dc207343-8cf7-468a-88ef-19288bc1bda5" status: 404 len: 109 microversion: 2.1 time: 0.830341 May 12 09:33:47.173064 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 8/10] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:33:46 2022] GET /compute/v2.1/os-volumes/dc207343-8cf7-468a-88ef-19288bc1bda5 => generated 109 bytes in 842 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:33:47.428815 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c5c88a94-480a-4f3c-8343-9897e87b0e16 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727f06430>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:47.587248 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c5c88a94-480a-4f3c-8343-9897e87b0e16 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 200 len: 345 microversion: 2.1 time: 0.162437 May 12 09:33:47.587901 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 3/11] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:33:47 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:47.599120 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-42d1ff0f-b1b4-411f-83bb-071fe5e3e508 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Action: 'create', calling method: .version_select at 0x7f8727eeaaf0>, body: {"snapshot": {"volume_id": "ad19cd81-73ec-4d6c-bac8-8f819c1b17de", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-349974144"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:33:48.033586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-42d1ff0f-b1b4-411f-83bb-071fe5e3e508 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.437945 May 12 09:33:48.035063 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 9/12] 10.222.0.60 () {60 vars in 1161 bytes} [Thu May 12 09:33:47 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:48.047949 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-61a490d6-9837-4b65-b7be-b14411c55965 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727ea2040>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:48.129739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-61a490d6-9837-4b65-b7be-b14411c55965 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 200 len: 286 microversion: 2.1 time: 0.089087 May 12 09:33:48.131618 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 10/13] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:48 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:33:48.143889 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4cb02f59-9ef8-4567-929d-c01abf5a676b tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727ea2700>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:48.252047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4cb02f59-9ef8-4567-929d-c01abf5a676b tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.108978 May 12 09:33:48.262849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 11/14] 10.222.0.60 () {58 vars in 1139 bytes} [Thu May 12 09:33:48 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:33:48.269331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6211973d-4172-40d4-bf21-c54840ef43ef tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727ea4430>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:48.327294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-736718105", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "networks": [{"uuid": "4b446bd8-08e4-4381-97bd-f3fde69be851"}]}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:33:48.328964 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6211973d-4172-40d4-bf21-c54840ef43ef tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 200 len: 286 microversion: 2.1 time: 0.064523 May 12 09:33:48.329776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 12/15] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:48 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:48.587711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] validate_networks() for [('4b446bd8-08e4-4381-97bd-f3fde69be851', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:33:49.341442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2a8aac87-de53-4f53-98e3-326db510304b tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727ea29d0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:49.410138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2a8aac87-de53-4f53-98e3-326db510304b tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 200 len: 286 microversion: 2.1 time: 0.071994 May 12 09:33:49.410747 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 13/16] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:49 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:33:50.218043 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7cd177b1-3972-49a0-995a-92de1ccc6ed9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: .version_select at 0x7f8727ea2280>, body: {"keypair": {"name": "tempest-keypair-1031176220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyhwlk4Cy2a/Wn7rYBw2l5UVMgxhZXqxYHNRwYlzfjKYMD3Ey3KcpYDaS67Gcy8r7EyJ5OpL9V5VvERtNOT9+BHr5vAtwcV8N7lYb4+d/RcIN4GdBi4rEEkgK12mYht0A=="}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:33:50.394296 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-7cd177b1-3972-49a0-995a-92de1ccc6ed9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:33:50.426845 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-7cd177b1-3972-49a0-995a-92de1ccc6ed9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for user 6c8297034cfa40438000e7d94419a429 and project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:33:50.547954 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7cd177b1-3972-49a0-995a-92de1ccc6ed9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.699273 May 12 09:33:50.555884 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 14/17] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:33:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:50.569263 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a1c4794a-4c77-414b-baed-b129245860a1 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727e029d0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:50.607946 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a1c4794a-4c77-414b-baed-b129245860a1 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 200 len: 286 microversion: 2.1 time: 0.051006 May 12 09:33:50.608779 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 15/18] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:50 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:51.479632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:33:51.480179 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:33:51.486382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:33:51.486976 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:33:51.490491 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:33:51.550214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:51.550922 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:51.557584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:51.560511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:51.620714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bec6b557-d9fb-49a9-8e00-b457005241e9 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727e310d0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:51.678504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-bec6b557-d9fb-49a9-8e00-b457005241e9 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 200 len: 286 microversion: 2.1 time: 0.062372 May 12 09:33:51.679153 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 16/19] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:51 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:33:51.694511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Getting quotas for project 2de1508e265140e5801827175c7da941. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:33:51.707804 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Getting quotas for user ded41aae383242789d1e468372767efb and project 2de1508e265140e5801827175c7da941. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:33:51.728291 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:33:51.749887 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:33:51.924686 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ae30c9a2-2862-4981-9987-2f1781bad64c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.902672 May 12 09:33:51.925891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 4/20] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:33:51.937021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7f41b429-56b4-4a03-b254-690aec145cd4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:51.937952 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7f41b429-56b4-4a03-b254-690aec145cd4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:33:52.187780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7f41b429-56b4-4a03-b254-690aec145cd4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:33:52.236771 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7f41b429-56b4-4a03-b254-690aec145cd4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1214 microversion: 2.1 time: 0.303916 May 12 09:33:52.244109 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 17/21] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:33:51 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1214 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:33:52.692901 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-fda2b0e2-8d43-4c10-ac70-2f94ecf0fbea tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727607e50>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:52.772518 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-fda2b0e2-8d43-4c10-ac70-2f94ecf0fbea tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 200 len: 286 microversion: 2.1 time: 0.085028 May 12 09:33:52.777116 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 5/22] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:52 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:53.265665 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-660b305f-940d-4364-8d5f-7c0d2223669c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:53.267282 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-660b305f-940d-4364-8d5f-7c0d2223669c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:33:53.546466 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-660b305f-940d-4364-8d5f-7c0d2223669c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:33:53.564079 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-660b305f-940d-4364-8d5f-7c0d2223669c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1214 microversion: 2.1 time: 0.307036 May 12 09:33:53.564674 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 18/23] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:33:53 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1214 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:33:53.738582 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1095029037", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8bd03ea-0f3b-46bf-82a8-531c929bec57"}], "security_groups": [{"name": "tempest-securitygroup--1541319123"}], "key_name": "tempest-keypair-1031176220", "user_data": "}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:33:53.788047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4df4671f-db5f-4ea3-b929-1e058a6a619c tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f87275e1af0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:53.881441 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4df4671f-db5f-4ea3-b929-1e058a6a619c tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 200 len: 286 microversion: 2.1 time: 0.100356 May 12 09:33:53.883096 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 19/24] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:53 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:54.176583 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] validate_networks() for [('d8bd03ea-0f3b-46bf-82a8-531c929bec57', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:33:54.585577 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bdedbde7-cf07-47ec-a5d1-f300c75066b3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:54.587332 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-bdedbde7-cf07-47ec-a5d1-f300c75066b3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:33:54.603118 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bdedbde7-cf07-47ec-a5d1-f300c75066b3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:54.604516 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bdedbde7-cf07-47ec-a5d1-f300c75066b3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:54.607365 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bdedbde7-cf07-47ec-a5d1-f300c75066b3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:54.610457 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bdedbde7-cf07-47ec-a5d1-f300c75066b3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:55.600953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-bdedbde7-cf07-47ec-a5d1-f300c75066b3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:33:55.636903 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-bdedbde7-cf07-47ec-a5d1-f300c75066b3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1266 microversion: 2.1 time: 1.033464 May 12 09:33:55.638483 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 20/25] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:33:54 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1266 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:33:55.653370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-20240b83-e128-45c2-9503-85fbcdbace03 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f872755dd30>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:55.704445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-20240b83-e128-45c2-9503-85fbcdbace03 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 200 len: 287 microversion: 2.1 time: 0.064645 May 12 09:33:55.710313 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 21/26] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:55 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:55.716168 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-54f786ad-fea4-4cd9-ab73-225b09c232a7 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727567670>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:55.865211 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-54f786ad-fea4-4cd9-ab73-225b09c232a7 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 202 len: 0 microversion: 2.1 time: 0.152713 May 12 09:33:55.866324 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 22/27] 10.222.0.60 () {58 vars in 1253 bytes} [Thu May 12 09:33:55 2022] DELETE /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 09:33:55.879087 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5355bef8-e3c9-4c33-9180-aef533bc5725 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f87274fb820>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:55.990768 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5355bef8-e3c9-4c33-9180-aef533bc5725 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 200 len: 286 microversion: 2.1 time: 0.118534 May 12 09:33:55.991332 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 23/28] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:55 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:33:56.455399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:33:56.455928 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:33:56.456568 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:33:56.457146 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:33:56.457568 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:33:56.478738 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:56.479173 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:56.480031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:56.480759 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:56.547483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:33:56.563460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for user 6c8297034cfa40438000e7d94419a429 and project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:33:56.596634 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:33:56.599033 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:33:56.655511 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-43f60fae-74b9-44d9-a35f-10cfc04c4806 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:56.660576 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-43f60fae-74b9-44d9-a35f-10cfc04c4806 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:33:56.696583 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-43f60fae-74b9-44d9-a35f-10cfc04c4806 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:56.697057 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-43f60fae-74b9-44d9-a35f-10cfc04c4806 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:56.705199 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-43f60fae-74b9-44d9-a35f-10cfc04c4806 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:56.705566 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-43f60fae-74b9-44d9-a35f-10cfc04c4806 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:56.736709 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-155378ea-9213-4161-9825-d593dc36b1ea tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.006423 May 12 09:33:56.743033 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 6/29] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:33:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 3014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:33:56.747795 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-19202beb-5ab9-45b8-bcc3-0ac73c99fd3a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:56.748406 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-19202beb-5ab9-45b8-bcc3-0ac73c99fd3a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:33:56.876275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-43f60fae-74b9-44d9-a35f-10cfc04c4806 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:33:56.890675 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-43f60fae-74b9-44d9-a35f-10cfc04c4806 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1272 microversion: 2.1 time: 0.239060 May 12 09:33:56.901177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 24/30] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:33:56 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:33:57.005106 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9a2db11c-32a9-4303-a9a6-f37acf2bf127 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727510670>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:57.050725 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-19202beb-5ab9-45b8-bcc3-0ac73c99fd3a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:33:57.085492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-9a2db11c-32a9-4303-a9a6-f37acf2bf127 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] HTTP exception thrown: Snapshot 2017e789-f356-46f2-917a-2e1ed85b3fc3 could not be found. May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9a2db11c-32a9-4303-a9a6-f37acf2bf127 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Request method failure captured: May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 HTTP/1.1 May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR2niTQu21a24o3CsrAs9j8A3QchPZy0AZ4Htcc9ww1e96P4ETNKG5m7KqGrJ5slzdrgjzr8mc_kCpyU_7LLiX8a5rWquQlN5jWuErNYbnQj3XKmxJNU6h7I43igZQhfYhtvdQJzsGrkYZVNmemcpcdHhyDdvoeODYZh1yiiyxWL5U May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: 48c6ab5a0a864171975aad8723b3ede8 May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:33:57.089518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_48c6ab5a0a864171975aad8723b3ede8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48c6ab5a0a864171975aad8723b3ede8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/48c6ab5a0a864171975aad8723b3ede8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48c6ab5a0a864171975aad8723b3ede8"}]}] May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: 48c6ab5a0a864171975aad8723b3ede8 May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesSnapshotsTestJSON-1421406604-project May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: b5b210bfb3f645348f521d7e2aee6bd1 May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1421406604-project May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Snapshot 2017e789-f356-46f2-917a-2e1ed85b3fc3 could not be found. May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '2017e789-f356-46f2-917a-2e1ed85b3fc3'} May 12 09:33:57.090993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2017e789-f356-46f2-917a-2e1ed85b3fc3 could not be found. (HTTP 404) (Request-ID: req-a757a817-2e38-417b-8996-5a0a55904bc2) May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:57.092026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:33:57.093218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2017e789-f356-46f2-917a-2e1ed85b3fc3 could not be found. May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 12 09:33:57.094765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2017e789-f356-46f2-917a-2e1ed85b3fc3 could not be found. May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2017e789-f356-46f2-917a-2e1ed85b3fc3 could not be found. May 12 09:33:57.097632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:33:57.104944 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9a2db11c-32a9-4303-a9a6-f37acf2bf127 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Returning 404 to user: Snapshot 2017e789-f356-46f2-917a-2e1ed85b3fc3 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:33:57.106363 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9a2db11c-32a9-4303-a9a6-f37acf2bf127 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3" status: 404 len: 111 microversion: 2.1 time: 0.105632 May 12 09:33:57.114698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 25/31] 10.222.0.60 () {58 vars in 1250 bytes} [Thu May 12 09:33:56 2022] GET /compute/v2.1/os-snapshots/2017e789-f356-46f2-917a-2e1ed85b3fc3 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 09:33:57.122657 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-19202beb-5ab9-45b8-bcc3-0ac73c99fd3a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1242 microversion: 2.1 time: 0.378254 May 12 09:33:57.123618 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 7/32] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:33:56 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1242 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:33:57.126313 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-13627805-3508-457b-885f-d2c7f253b5e6 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f872752e310>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:57.326263 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-13627805-3508-457b-885f-d2c7f253b5e6 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 202 len: 0 microversion: 2.1 time: 0.203662 May 12 09:33:57.326853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 26/33] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:33:57 2022] DELETE /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:33:57.348208 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2fcb0c3c-2a20-44c5-a8b8-84a796af0127 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727638ee0>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:57.539268 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2fcb0c3c-2a20-44c5-a8b8-84a796af0127 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 200 len: 344 microversion: 2.1 time: 0.206384 May 12 09:33:57.545751 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 8/34] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:33:57 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 344 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:57.924262 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-38e5145c-6ffc-43cc-98d7-84afe0bae4bb tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:57.925604 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-38e5145c-6ffc-43cc-98d7-84afe0bae4bb tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:33:57.951383 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-38e5145c-6ffc-43cc-98d7-84afe0bae4bb tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:57.952030 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-38e5145c-6ffc-43cc-98d7-84afe0bae4bb tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:57.955167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-38e5145c-6ffc-43cc-98d7-84afe0bae4bb tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:57.957948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-38e5145c-6ffc-43cc-98d7-84afe0bae4bb tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:58.142615 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-afaaedda-2494-48db-b8e4-7b135997a901 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:58.143296 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-afaaedda-2494-48db-b8e4-7b135997a901 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:33:58.406210 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-38e5145c-6ffc-43cc-98d7-84afe0bae4bb tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:33:58.426451 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-38e5145c-6ffc-43cc-98d7-84afe0bae4bb tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1272 microversion: 2.1 time: 0.506344 May 12 09:33:58.428251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 27/35] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:33:57 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1272 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:33:58.463195 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-afaaedda-2494-48db-b8e4-7b135997a901 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:33:58.471373 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-afaaedda-2494-48db-b8e4-7b135997a901 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1242 microversion: 2.1 time: 0.334095 May 12 09:33:58.481009 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 9/36] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:33:58 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1242 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:33:58.553766 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5fb79f04-8033-4a19-a4ec-a4ac6c39e4e1 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f872755ddc0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:58.733420 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5fb79f04-8033-4a19-a4ec-a4ac6c39e4e1 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 200 len: 344 microversion: 2.1 time: 0.183506 May 12 09:33:58.742700 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 28/37] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:33:58 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 344 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:59.449026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-86fecc99-456f-4fed-8962-0f194aefc41c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:59.449695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-86fecc99-456f-4fed-8962-0f194aefc41c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:33:59.452918 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-48acd7ac-38e3-4ed3-962a-17bdf6f46384 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'create', calling method: .version_select at 0x7f8727627550>, body: {"keypair": {"name": "tempest-keypair-2044159736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrTEr8qIU5vKM8zNP1yOm+wx/PWos3mDPqv7UIZ6k4zLYXB1Je6L4FU1qgFN/tXectRmTatYPdGTq/Xznc+z+gFCXQBlFs+t8IW+MoLBHTrsq/UIusr81jTyiTX6XIEMg=="}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:33:59.479082 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86fecc99-456f-4fed-8962-0f194aefc41c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:59.479534 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86fecc99-456f-4fed-8962-0f194aefc41c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:59.480404 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86fecc99-456f-4fed-8962-0f194aefc41c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:59.481093 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86fecc99-456f-4fed-8962-0f194aefc41c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:59.553315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-48acd7ac-38e3-4ed3-962a-17bdf6f46384 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Getting quotas for project da5b9f41ad6b4506872df6cb86ae9f73. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:33:59.592388 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-48acd7ac-38e3-4ed3-962a-17bdf6f46384 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Getting quotas for user 2efdff1c390f4271963e932af8abd473 and project da5b9f41ad6b4506872df6cb86ae9f73. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:33:59.665201 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-48acd7ac-38e3-4ed3-962a-17bdf6f46384 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.578944 May 12 09:33:59.671951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 10/38] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:33:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:33:59.685815 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c37d1080-57b5-4b3d-8dda-0672e694825d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:59.689245 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c37d1080-57b5-4b3d-8dda-0672e694825d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:33:59.701721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c37d1080-57b5-4b3d-8dda-0672e694825d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:59.704275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c37d1080-57b5-4b3d-8dda-0672e694825d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:59.705400 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c37d1080-57b5-4b3d-8dda-0672e694825d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:33:59.707939 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c37d1080-57b5-4b3d-8dda-0672e694825d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:33:59.741758 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-86fecc99-456f-4fed-8962-0f194aefc41c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:33:59.762847 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-86fecc99-456f-4fed-8962-0f194aefc41c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1272 microversion: 2.1 time: 0.320261 May 12 09:33:59.766701 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 29/39] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:33:59 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:33:59.784177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3896ed52-47f9-4ea1-8dc4-a3661a5efb8f tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f872755ddc0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:33:59.923811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3896ed52-47f9-4ea1-8dc4-a3661a5efb8f tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 200 len: 344 microversion: 2.1 time: 0.155736 May 12 09:33:59.929018 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 30/40] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:33:59 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 344 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:00.190789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c37d1080-57b5-4b3d-8dda-0672e694825d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:00.216574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c37d1080-57b5-4b3d-8dda-0672e694825d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1246 microversion: 2.1 time: 0.543281 May 12 09:34:00.218612 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 11/41] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:33:59 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1246 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:00.665634 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1669154147", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:00.793278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a8dd1379-bfc7-4c11-b5cd-cf52f93dba70 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:00.795663 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a8dd1379-bfc7-4c11-b5cd-cf52f93dba70 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:00.829697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] validate_networks() for [('94c124bd-d4ff-4709-8b22-7520113efef5', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:34:00.832619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a8dd1379-bfc7-4c11-b5cd-cf52f93dba70 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:00.834496 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a8dd1379-bfc7-4c11-b5cd-cf52f93dba70 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:00.849317 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a8dd1379-bfc7-4c11-b5cd-cf52f93dba70 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:00.853211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a8dd1379-bfc7-4c11-b5cd-cf52f93dba70 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:01.669067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a8dd1379-bfc7-4c11-b5cd-cf52f93dba70 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:01.682610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a8dd1379-bfc7-4c11-b5cd-cf52f93dba70 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.903215 May 12 09:34:01.683811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 12/42] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:00 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:01.710250 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-841e366e-6e6b-482b-94c5-28d02d295a8a tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8726530550>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:01.861989 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-841e366e-6e6b-482b-94c5-28d02d295a8a tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 200 len: 344 microversion: 2.1 time: 0.176916 May 12 09:34:01.862820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 13/43] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:34:01 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 344 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:01.869398 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-34a29ab0-06a8-45df-a4a3-7dc1f47eb27c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:01.870406 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-34a29ab0-06a8-45df-a4a3-7dc1f47eb27c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:01.880152 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-34a29ab0-06a8-45df-a4a3-7dc1f47eb27c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:01.881635 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-34a29ab0-06a8-45df-a4a3-7dc1f47eb27c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:01.885624 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-34a29ab0-06a8-45df-a4a3-7dc1f47eb27c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:01.890260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-34a29ab0-06a8-45df-a4a3-7dc1f47eb27c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:02.329365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-34a29ab0-06a8-45df-a4a3-7dc1f47eb27c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:02.339488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-34a29ab0-06a8-45df-a4a3-7dc1f47eb27c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1238 microversion: 2.1 time: 0.474341 May 12 09:34:02.340081 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 14/44] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:01 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1238 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:02.628561 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:34:02.629215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:34:02.629713 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:34:02.630262 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:34:02.630579 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:34:02.654019 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:02.654553 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:02.655453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:02.655898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:02.709489 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6347544e-7559-4092-9490-1f66c8a17c6e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:02.710401 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6347544e-7559-4092-9490-1f66c8a17c6e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:02.727514 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6347544e-7559-4092-9490-1f66c8a17c6e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:02.728633 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6347544e-7559-4092-9490-1f66c8a17c6e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:02.732090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6347544e-7559-4092-9490-1f66c8a17c6e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:02.734197 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6347544e-7559-4092-9490-1f66c8a17c6e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:02.761860 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Getting quotas for project c54669eadc784d4aac5d1a40d18858b1. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:34:02.772663 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Getting quotas for user 0b01be56426e4ff1a09577f30fb79f0b and project c54669eadc784d4aac5d1a40d18858b1. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:34:02.815986 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:34:02.823430 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:34:03.000767 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-59526736-1c38-4d84-80a9-0350caba0484 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.808630 May 12 09:34:03.007262 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 31/45] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:34:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:34:03.008719 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-969948401", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "157184d7-26b8-47d5-86e0-3945164ff04d"}], "security_groups": [{"name": "tempest-securitygroup--1253925298"}], "key_name": "tempest-keypair-2044159736", "user_data": "}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:03.447994 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] validate_networks() for [('157184d7-26b8-47d5-86e0-3945164ff04d', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:34:03.715581 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6347544e-7559-4092-9490-1f66c8a17c6e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:03.736831 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6347544e-7559-4092-9490-1f66c8a17c6e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 1.039321 May 12 09:34:03.745760 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 15/46] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:02 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:03.764851 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a598bacd-d40a-4b30-9918-6829cf4315e0 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8726538dc0>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:03.858774 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a598bacd-d40a-4b30-9918-6829cf4315e0 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 200 len: 344 microversion: 2.1 time: 0.111240 May 12 09:34:03.860041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 16/47] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:34:03 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:03.882543 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-003670c2-67f0-4441-9eed-c31c739fd818 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:03.883742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-003670c2-67f0-4441-9eed-c31c739fd818 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:03.899713 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-003670c2-67f0-4441-9eed-c31c739fd818 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:03.902419 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-003670c2-67f0-4441-9eed-c31c739fd818 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:03.903610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-003670c2-67f0-4441-9eed-c31c739fd818 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:03.905714 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-003670c2-67f0-4441-9eed-c31c739fd818 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:04.017688 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-003670c2-67f0-4441-9eed-c31c739fd818 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:04.027358 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-003670c2-67f0-4441-9eed-c31c739fd818 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1226 microversion: 2.1 time: 0.165529 May 12 09:34:04.050003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 17/48] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:03 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:04.055105 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-95b8137b-6604-4778-b01d-5182d791bf55 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:04.056078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-95b8137b-6604-4778-b01d-5182d791bf55 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:04.063252 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-95b8137b-6604-4778-b01d-5182d791bf55 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:04.063968 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-95b8137b-6604-4778-b01d-5182d791bf55 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:04.066295 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-95b8137b-6604-4778-b01d-5182d791bf55 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:04.066922 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-95b8137b-6604-4778-b01d-5182d791bf55 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:04.197677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-95b8137b-6604-4778-b01d-5182d791bf55 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:04.206449 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-95b8137b-6604-4778-b01d-5182d791bf55 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1238 microversion: 2.1 time: 0.155155 May 12 09:34:04.220637 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 18/49] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:04 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1238 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:04.247728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1389773549", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:04.300478 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] validate_networks() for [('94c124bd-d4ff-4709-8b22-7520113efef5', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:34:04.411276 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:34:04.411813 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:34:04.412612 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:34:04.413011 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:34:04.414248 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:34:04.424621 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:04.425346 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:04.426181 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:04.426828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:04.448408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Getting quotas for project da5b9f41ad6b4506872df6cb86ae9f73. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:34:04.457401 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Getting quotas for user 2efdff1c390f4271963e932af8abd473 and project da5b9f41ad6b4506872df6cb86ae9f73. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:34:04.483777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:34:04.486826 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:34:04.544819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-20261148-062d-4ae9-926d-aebb6a43c4bd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.541234 May 12 09:34:04.545636 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 32/50] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:34:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:34:04.560690 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3880f934-dfb7-4a62-af36-4185f488b636 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:04.561811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3880f934-dfb7-4a62-af36-4185f488b636 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:04.660181 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3880f934-dfb7-4a62-af36-4185f488b636 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:04.678194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3880f934-dfb7-4a62-af36-4185f488b636 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1237 microversion: 2.1 time: 0.121389 May 12 09:34:04.691152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 33/51] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:04 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1237 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:04.759148 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7fea73cb-a16c-46c7-bd33-da831424da78 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:04.759910 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7fea73cb-a16c-46c7-bd33-da831424da78 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:04.769684 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7fea73cb-a16c-46c7-bd33-da831424da78 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:04.770594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7fea73cb-a16c-46c7-bd33-da831424da78 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:04.771852 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7fea73cb-a16c-46c7-bd33-da831424da78 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:04.772604 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7fea73cb-a16c-46c7-bd33-da831424da78 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.076626 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:34:05.077114 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:34:05.077463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:34:05.078020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:34:05.078441 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:34:05.080637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7fea73cb-a16c-46c7-bd33-da831424da78 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:05.087817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7fea73cb-a16c-46c7-bd33-da831424da78 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.333238 May 12 09:34:05.088391 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 34/52] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:04 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:05.090721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:05.091480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.093132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:05.093593 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.102483 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-76945ba4-ee1e-4828-8a22-44aca5507a95 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f87274b1dc0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:05.118972 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Getting quotas for project c54669eadc784d4aac5d1a40d18858b1. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:34:05.123014 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Getting quotas for user 0b01be56426e4ff1a09577f30fb79f0b and project c54669eadc784d4aac5d1a40d18858b1. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:34:05.165039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:34:05.167137 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:34:05.171726 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-76945ba4-ee1e-4828-8a22-44aca5507a95 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 200 len: 344 microversion: 2.1 time: 0.082247 May 12 09:34:05.172411 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 35/53] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:34:05 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:05.232547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-afb9e942-eb93-462a-bc49-f6fd6f09e462 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.988898 May 12 09:34:05.233324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 19/54] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:34:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 09:34:05.238001 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9c423b30-611c-4b10-91c9-0afda6e4a597 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:05.238652 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9c423b30-611c-4b10-91c9-0afda6e4a597 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:05.245811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9c423b30-611c-4b10-91c9-0afda6e4a597 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:05.246343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9c423b30-611c-4b10-91c9-0afda6e4a597 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.247227 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9c423b30-611c-4b10-91c9-0afda6e4a597 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:05.247596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9c423b30-611c-4b10-91c9-0afda6e4a597 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.248012 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-43a1894e-fcf9-4b43-83ac-5f66fe877a29 req-e9a8dc3f-283a-49d6-b62a-3e42816ae370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b658c976-df06-49bb-9c2d-4d42cead8156", "tag": "a1f179d2-9260-4805-a962-5a7091a5b50a"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:05.269450 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-43a1894e-fcf9-4b43-83ac-5f66fe877a29 req-e9a8dc3f-283a-49d6-b62a-3e42816ae370 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:05.269925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-43a1894e-fcf9-4b43-83ac-5f66fe877a29 req-e9a8dc3f-283a-49d6-b62a-3e42816ae370 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.291087 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-43a1894e-fcf9-4b43-83ac-5f66fe877a29 req-e9a8dc3f-283a-49d6-b62a-3e42816ae370 service nova] Creating event network-changed:a1f179d2-9260-4805-a962-5a7091a5b50a for instance b658c976-df06-49bb-9c2d-4d42cead8156 on hv-cinder-83769 May 12 09:34:05.291881 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-43a1894e-fcf9-4b43-83ac-5f66fe877a29 req-e9a8dc3f-283a-49d6-b62a-3e42816ae370 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123510) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 09:34:05.293139 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-12a2d97d-9e17-401d-ad54-e3d6b2747782 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:05.293735 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-12a2d97d-9e17-401d-ad54-e3d6b2747782 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.294679 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-12a2d97d-9e17-401d-ad54-e3d6b2747782 None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:05.295259 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-12a2d97d-9e17-401d-ad54-e3d6b2747782 None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.306125 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.compute.rpcapi [None req-12a2d97d-9e17-401d-ad54-e3d6b2747782 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 09:34:05.307190 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-12a2d97d-9e17-401d-ad54-e3d6b2747782 None None] Releasing lock "compute-rpcapi-router" {{(pid=123510) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 09:34:05.315113 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9c423b30-611c-4b10-91c9-0afda6e4a597 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:05.322285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-12a2d97d-9e17-401d-ad54-e3d6b2747782 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148468 May 12 09:34:05.322944 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 36/55] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:05.326472 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9c423b30-611c-4b10-91c9-0afda6e4a597 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1238 microversion: 2.1 time: 0.089015 May 12 09:34:05.335519 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 20/56] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:05 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:05.336338 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f2161a90-4e64-4f4f-b178-51bf9e42da3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:05.336338 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f2161a90-4e64-4f4f-b178-51bf9e42da3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:05.383345 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f2161a90-4e64-4f4f-b178-51bf9e42da3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:05.390315 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f2161a90-4e64-4f4f-b178-51bf9e42da3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1222 microversion: 2.1 time: 0.066250 May 12 09:34:05.391456 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 37/57] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:05 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:05.704350 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-dddb80de-00de-4cc2-a320-f21279fdb947 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:05.704964 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-dddb80de-00de-4cc2-a320-f21279fdb947 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:05.713878 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dddb80de-00de-4cc2-a320-f21279fdb947 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:05.714547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dddb80de-00de-4cc2-a320-f21279fdb947 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.715784 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dddb80de-00de-4cc2-a320-f21279fdb947 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:05.716557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dddb80de-00de-4cc2-a320-f21279fdb947 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:05.827548 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-dddb80de-00de-4cc2-a320-f21279fdb947 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:05.835186 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-dddb80de-00de-4cc2-a320-f21279fdb947 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1241 microversion: 2.1 time: 0.140224 May 12 09:34:05.836469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 21/58] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:05 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:06.105231 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0b7221c9-3586-4346-89ea-d045b6f9899d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:06.105952 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0b7221c9-3586-4346-89ea-d045b6f9899d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:06.112183 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0b7221c9-3586-4346-89ea-d045b6f9899d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:06.112714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0b7221c9-3586-4346-89ea-d045b6f9899d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:06.113706 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0b7221c9-3586-4346-89ea-d045b6f9899d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:06.114240 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0b7221c9-3586-4346-89ea-d045b6f9899d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:06.184083 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-01f400e6-9bde-49d5-9619-85267ea9e8c1 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f87264cd550>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:06.277189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-0b7221c9-3586-4346-89ea-d045b6f9899d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:06.284348 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-01f400e6-9bde-49d5-9619-85267ea9e8c1 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 200 len: 344 microversion: 2.1 time: 0.103969 May 12 09:34:06.284738 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-0b7221c9-3586-4346-89ea-d045b6f9899d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.183414 May 12 09:34:06.285324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 22/59] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:34:06 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:34:06.294012 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 38/60] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:06 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:06.342922 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c566ce2b-2571-47d0-81d9-14b6e401d751 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:06.343540 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c566ce2b-2571-47d0-81d9-14b6e401d751 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:06.349532 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c566ce2b-2571-47d0-81d9-14b6e401d751 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:06.350037 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c566ce2b-2571-47d0-81d9-14b6e401d751 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:06.350793 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c566ce2b-2571-47d0-81d9-14b6e401d751 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:06.351298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c566ce2b-2571-47d0-81d9-14b6e401d751 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:06.408613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-366f10d9-5ce6-4f06-8f45-f0f4cc172dc7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:06.409229 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-366f10d9-5ce6-4f06-8f45-f0f4cc172dc7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:06.417427 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c566ce2b-2571-47d0-81d9-14b6e401d751 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:06.421425 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-366f10d9-5ce6-4f06-8f45-f0f4cc172dc7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:06.422127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-366f10d9-5ce6-4f06-8f45-f0f4cc172dc7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:06.423234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-366f10d9-5ce6-4f06-8f45-f0f4cc172dc7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:06.424701 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-366f10d9-5ce6-4f06-8f45-f0f4cc172dc7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:06.434578 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c566ce2b-2571-47d0-81d9-14b6e401d751 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1294 microversion: 2.1 time: 0.095437 May 12 09:34:06.435264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 23/61] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:06 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:06.486622 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-366f10d9-5ce6-4f06-8f45-f0f4cc172dc7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:06.494531 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-366f10d9-5ce6-4f06-8f45-f0f4cc172dc7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1226 microversion: 2.1 time: 0.089540 May 12 09:34:06.495087 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 39/62] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:06 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:06.853949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-645ef270-e8bc-4064-b1ca-168865c3d421 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:06.854385 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-645ef270-e8bc-4064-b1ca-168865c3d421 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:06.860971 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-645ef270-e8bc-4064-b1ca-168865c3d421 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:06.862037 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-645ef270-e8bc-4064-b1ca-168865c3d421 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:06.863041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-645ef270-e8bc-4064-b1ca-168865c3d421 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:06.863827 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-645ef270-e8bc-4064-b1ca-168865c3d421 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:06.931370 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-645ef270-e8bc-4064-b1ca-168865c3d421 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:06.938657 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-645ef270-e8bc-4064-b1ca-168865c3d421 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1241 microversion: 2.1 time: 0.090021 May 12 09:34:06.939308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 24/63] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:06 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:07.300480 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6d3ce6b1-615e-4657-887c-8cf3c183f2df tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8725c17b80>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:07.301115 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9a393df6-8454-46f2-a389-8be4b21a2d3e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:07.301737 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9a393df6-8454-46f2-a389-8be4b21a2d3e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:07.308159 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a393df6-8454-46f2-a389-8be4b21a2d3e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:07.308612 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a393df6-8454-46f2-a389-8be4b21a2d3e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:07.309398 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a393df6-8454-46f2-a389-8be4b21a2d3e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:07.309811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a393df6-8454-46f2-a389-8be4b21a2d3e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:07.378225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-6d3ce6b1-615e-4657-887c-8cf3c183f2df tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] HTTP exception thrown: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6d3ce6b1-615e-4657-887c-8cf3c183f2df tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Request method failure captured: May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de HTTP/1.1 May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR2niTQu21a24o3CsrAs9j8A3QchPZy0AZ4Htcc9ww1e96P4ETNKG5m7KqGrJ5slzdrgjzr8mc_kCpyU_7LLiX8a5rWquQlN5jWuErNYbnQj3XKmxJNU6h7I43igZQhfYhtvdQJzsGrkYZVNmemcpcdHhyDdvoeODYZh1yiiyxWL5U May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: 48c6ab5a0a864171975aad8723b3ede8 May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:34:07.380582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_48c6ab5a0a864171975aad8723b3ede8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48c6ab5a0a864171975aad8723b3ede8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/48c6ab5a0a864171975aad8723b3ede8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48c6ab5a0a864171975aad8723b3ede8"}]}] May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: 48c6ab5a0a864171975aad8723b3ede8 May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesSnapshotsTestJSON-1421406604-project May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: b5b210bfb3f645348f521d7e2aee6bd1 May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1421406604-project May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'ad19cd81-73ec-4d6c-bac8-8f819c1b17de'} May 12 09:34:07.381698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. (HTTP 404) (Request-ID: req-a9a5f910-d18f-425a-8330-18289e5992de) May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:34:07.383187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:34:07.384586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 09:34:07.388037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6d3ce6b1-615e-4657-887c-8cf3c183f2df tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Returning 404 to user: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:34:07.391086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6d3ce6b1-615e-4657-887c-8cf3c183f2df tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 404 len: 109 microversion: 2.1 time: 0.091410 May 12 09:34:07.395982 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 40/64] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:34:07 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:34:07.406569 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d0659c8f-3010-495f-87f6-d4a3e5fa07fe tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8727ea2dc0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:07.443612 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-d0659c8f-3010-495f-87f6-d4a3e5fa07fe tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] HTTP exception thrown: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d0659c8f-3010-495f-87f6-d4a3e5fa07fe tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Request method failure captured: May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: DELETE /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de HTTP/1.1 May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR2niTQu21a24o3CsrAs9j8A3QchPZy0AZ4Htcc9ww1e96P4ETNKG5m7KqGrJ5slzdrgjzr8mc_kCpyU_7LLiX8a5rWquQlN5jWuErNYbnQj3XKmxJNU6h7I43igZQhfYhtvdQJzsGrkYZVNmemcpcdHhyDdvoeODYZh1yiiyxWL5U May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: 48c6ab5a0a864171975aad8723b3ede8 May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:34:07.447890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_48c6ab5a0a864171975aad8723b3ede8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48c6ab5a0a864171975aad8723b3ede8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/48c6ab5a0a864171975aad8723b3ede8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48c6ab5a0a864171975aad8723b3ede8"}]}] May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: 48c6ab5a0a864171975aad8723b3ede8 May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesSnapshotsTestJSON-1421406604-project May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: b5b210bfb3f645348f521d7e2aee6bd1 May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1421406604-project May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'ad19cd81-73ec-4d6c-bac8-8f819c1b17de'} May 12 09:34:07.449004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. (HTTP 404) (Request-ID: req-ff949c33-f132-44c4-b5cf-92bb459e8982) May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:34:07.449683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 12 09:34:07.451213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 12 09:34:07.452144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d0659c8f-3010-495f-87f6-d4a3e5fa07fe tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Returning 404 to user: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d0659c8f-3010-495f-87f6-d4a3e5fa07fe tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 404 len: 109 microversion: 2.1 time: 0.051550 May 12 09:34:07.453538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 41/65] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:34:07 2022] DELETE /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:34:07.455739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-41d74b8f-429d-4120-99d7-99fcb65f80c1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:07.456009 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-41d74b8f-429d-4120-99d7-99fcb65f80c1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:07.465999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-41d74b8f-429d-4120-99d7-99fcb65f80c1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:07.466451 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-41d74b8f-429d-4120-99d7-99fcb65f80c1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:07.467382 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-41d74b8f-429d-4120-99d7-99fcb65f80c1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:07.467822 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-41d74b8f-429d-4120-99d7-99fcb65f80c1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:07.501751 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9a393df6-8454-46f2-a389-8be4b21a2d3e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:07.520315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9a393df6-8454-46f2-a389-8be4b21a2d3e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.222910 May 12 09:34:07.521355 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 25/66] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:07 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:07.526558 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7c9700b1-3781-4272-9f20-ec18e9abad62 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Calling method '.version_select at 0x7f8726530790>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:07.552472 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-41d74b8f-429d-4120-99d7-99fcb65f80c1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:07.561920 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-41d74b8f-429d-4120-99d7-99fcb65f80c1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1294 microversion: 2.1 time: 0.110144 May 12 09:34:07.562499 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 42/67] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:07 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:07.569308 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-61dfff1f-a2fe-4e40-8372-992261eb6cf2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:07.570251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-61dfff1f-a2fe-4e40-8372-992261eb6cf2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:07.571139 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-7c9700b1-3781-4272-9f20-ec18e9abad62 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] HTTP exception thrown: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7c9700b1-3781-4272-9f20-ec18e9abad62 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Request method failure captured: May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de HTTP/1.1 May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR2niTQu21a24o3CsrAs9j8A3QchPZy0AZ4Htcc9ww1e96P4ETNKG5m7KqGrJ5slzdrgjzr8mc_kCpyU_7LLiX8a5rWquQlN5jWuErNYbnQj3XKmxJNU6h7I43igZQhfYhtvdQJzsGrkYZVNmemcpcdHhyDdvoeODYZh1yiiyxWL5U May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: 48c6ab5a0a864171975aad8723b3ede8 May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:34:07.575513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_48c6ab5a0a864171975aad8723b3ede8", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48c6ab5a0a864171975aad8723b3ede8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/48c6ab5a0a864171975aad8723b3ede8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/48c6ab5a0a864171975aad8723b3ede8"}]}] May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: 48c6ab5a0a864171975aad8723b3ede8 May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1421406604 May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-VolumesSnapshotsTestJSON-1421406604-project May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: b5b210bfb3f645348f521d7e2aee6bd1 May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1421406604-project May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'ad19cd81-73ec-4d6c-bac8-8f819c1b17de'} May 12 09:34:07.576599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. (HTTP 404) (Request-ID: req-0be07b47-6ea8-4377-b727-5dbb62e54a1c) May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:34:07.577254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:34:07.578298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 09:34:07.579436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:34:07.581640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7c9700b1-3781-4272-9f20-ec18e9abad62 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] Returning 404 to user: Volume ad19cd81-73ec-4d6c-bac8-8f819c1b17de could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:34:07.584384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61dfff1f-a2fe-4e40-8372-992261eb6cf2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:07.584608 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7c9700b1-3781-4272-9f20-ec18e9abad62 tempest-VolumesSnapshotsTestJSON-1421406604 tempest-VolumesSnapshotsTestJSON-1421406604-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de" status: 404 len: 109 microversion: 2.1 time: 0.054504 May 12 09:34:07.584678 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61dfff1f-a2fe-4e40-8372-992261eb6cf2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:07.584751 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 26/68] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:34:07 2022] GET /compute/v2.1/os-volumes/ad19cd81-73ec-4d6c-bac8-8f819c1b17de => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:34:07.584834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61dfff1f-a2fe-4e40-8372-992261eb6cf2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:07.584834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61dfff1f-a2fe-4e40-8372-992261eb6cf2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:07.644328 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-61dfff1f-a2fe-4e40-8372-992261eb6cf2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:07.652796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-61dfff1f-a2fe-4e40-8372-992261eb6cf2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1226 microversion: 2.1 time: 0.089069 May 12 09:34:07.653817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 43/69] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:07 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:07.972327 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c3614e0f-fc39-4b84-b153-658e98ada3da tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:07.973198 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c3614e0f-fc39-4b84-b153-658e98ada3da tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:07.986786 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c3614e0f-fc39-4b84-b153-658e98ada3da tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:07.987579 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c3614e0f-fc39-4b84-b153-658e98ada3da tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:07.988704 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c3614e0f-fc39-4b84-b153-658e98ada3da tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:07.989298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c3614e0f-fc39-4b84-b153-658e98ada3da tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:08.121347 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c3614e0f-fc39-4b84-b153-658e98ada3da tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:08.131357 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c3614e0f-fc39-4b84-b153-658e98ada3da tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1241 microversion: 2.1 time: 0.172844 May 12 09:34:08.133096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 27/70] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:07 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1241 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:08.538639 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7ff706e6-7fd1-45ec-957d-fe9d186906d4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:08.539230 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7ff706e6-7fd1-45ec-957d-fe9d186906d4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:08.555466 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ff706e6-7fd1-45ec-957d-fe9d186906d4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:08.556464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ff706e6-7fd1-45ec-957d-fe9d186906d4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:08.557489 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ff706e6-7fd1-45ec-957d-fe9d186906d4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:08.558145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ff706e6-7fd1-45ec-957d-fe9d186906d4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:08.579770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6b184863-b36d-482e-9ebe-947ee4b1a239 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:08.581287 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6b184863-b36d-482e-9ebe-947ee4b1a239 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:08.600923 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6b184863-b36d-482e-9ebe-947ee4b1a239 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:08.602345 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6b184863-b36d-482e-9ebe-947ee4b1a239 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:08.603174 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6b184863-b36d-482e-9ebe-947ee4b1a239 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:08.604782 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6b184863-b36d-482e-9ebe-947ee4b1a239 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:08.790472 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6b184863-b36d-482e-9ebe-947ee4b1a239 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:08.809467 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6b184863-b36d-482e-9ebe-947ee4b1a239 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1294 microversion: 2.1 time: 0.234236 May 12 09:34:08.812437 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 28/71] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:08 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1294 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:08.819817 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4635e6d9-6330-443e-9a50-e1df4e51055d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:08.834811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4635e6d9-6330-443e-9a50-e1df4e51055d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:08.846090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4635e6d9-6330-443e-9a50-e1df4e51055d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:08.846620 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4635e6d9-6330-443e-9a50-e1df4e51055d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:08.848241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4635e6d9-6330-443e-9a50-e1df4e51055d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:08.849313 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4635e6d9-6330-443e-9a50-e1df4e51055d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:08.928599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7ff706e6-7fd1-45ec-957d-fe9d186906d4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:08.953560 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7ff706e6-7fd1-45ec-957d-fe9d186906d4 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.420275 May 12 09:34:08.954660 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 44/72] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:08 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:09.022264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4635e6d9-6330-443e-9a50-e1df4e51055d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:09.029758 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4635e6d9-6330-443e-9a50-e1df4e51055d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1226 microversion: 2.1 time: 0.216052 May 12 09:34:09.030444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 29/73] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:08 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1226 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:09.152872 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1e4494ed-5f17-4fe1-8334-725dff5c1985 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:09.161726 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1e4494ed-5f17-4fe1-8334-725dff5c1985 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:09.174505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1e4494ed-5f17-4fe1-8334-725dff5c1985 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:09.175358 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1e4494ed-5f17-4fe1-8334-725dff5c1985 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:09.176520 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1e4494ed-5f17-4fe1-8334-725dff5c1985 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:09.177440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1e4494ed-5f17-4fe1-8334-725dff5c1985 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:09.312806 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1e4494ed-5f17-4fe1-8334-725dff5c1985 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:09.334283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1e4494ed-5f17-4fe1-8334-725dff5c1985 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1241 microversion: 2.1 time: 0.184953 May 12 09:34:09.336310 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 45/74] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:09 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1241 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:09.828220 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1357c401-e370-4adf-8e2e-3ba7c6b0863b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:09.829234 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1357c401-e370-4adf-8e2e-3ba7c6b0863b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:09.843432 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1357c401-e370-4adf-8e2e-3ba7c6b0863b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:09.850783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1357c401-e370-4adf-8e2e-3ba7c6b0863b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:09.859263 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1357c401-e370-4adf-8e2e-3ba7c6b0863b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:09.861247 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1357c401-e370-4adf-8e2e-3ba7c6b0863b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:09.973072 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-150ec9f6-c289-48c6-ab46-0a2c41f02894 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:09.974674 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-150ec9f6-c289-48c6-ab46-0a2c41f02894 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:09.987985 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-150ec9f6-c289-48c6-ab46-0a2c41f02894 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:09.990855 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-150ec9f6-c289-48c6-ab46-0a2c41f02894 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:09.993017 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-150ec9f6-c289-48c6-ab46-0a2c41f02894 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:09.994853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-150ec9f6-c289-48c6-ab46-0a2c41f02894 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:10.039833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1357c401-e370-4adf-8e2e-3ba7c6b0863b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:10.051156 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1357c401-e370-4adf-8e2e-3ba7c6b0863b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1294 microversion: 2.1 time: 0.228354 May 12 09:34:10.068275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 30/75] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:09 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1294 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:10.076384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c2302c81-507c-4e64-a91f-9d82c63a45e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:10.083221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c2302c81-507c-4e64-a91f-9d82c63a45e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:10.092757 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2302c81-507c-4e64-a91f-9d82c63a45e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:10.096418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2302c81-507c-4e64-a91f-9d82c63a45e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:10.099378 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2302c81-507c-4e64-a91f-9d82c63a45e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:10.102443 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2302c81-507c-4e64-a91f-9d82c63a45e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:10.378247 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c2302c81-507c-4e64-a91f-9d82c63a45e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:10.388732 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c2302c81-507c-4e64-a91f-9d82c63a45e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1226 microversion: 2.1 time: 0.318147 May 12 09:34:10.390573 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 31/76] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:10 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1226 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:10.397304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-462d80c1-d0ed-470a-91a5-8f52f5aead6a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:10.398159 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-462d80c1-d0ed-470a-91a5-8f52f5aead6a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:10.407138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-150ec9f6-c289-48c6-ab46-0a2c41f02894 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:10.414550 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-462d80c1-d0ed-470a-91a5-8f52f5aead6a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:10.415481 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-462d80c1-d0ed-470a-91a5-8f52f5aead6a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:10.417157 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-462d80c1-d0ed-470a-91a5-8f52f5aead6a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:10.417837 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-462d80c1-d0ed-470a-91a5-8f52f5aead6a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:10.421884 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-150ec9f6-c289-48c6-ab46-0a2c41f02894 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.453931 May 12 09:34:10.422930 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 46/77] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:09 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:10.569339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-462d80c1-d0ed-470a-91a5-8f52f5aead6a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:10.577071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-462d80c1-d0ed-470a-91a5-8f52f5aead6a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1241 microversion: 2.1 time: 0.185300 May 12 09:34:10.587068 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 32/78] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:10 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1241 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:11.073831 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-385a1c34-39be-404d-b96a-a915c080f0f6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:11.075342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-385a1c34-39be-404d-b96a-a915c080f0f6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:11.083200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-385a1c34-39be-404d-b96a-a915c080f0f6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:11.083662 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-385a1c34-39be-404d-b96a-a915c080f0f6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:11.084616 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-385a1c34-39be-404d-b96a-a915c080f0f6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:11.085391 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-385a1c34-39be-404d-b96a-a915c080f0f6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:11.167142 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-385a1c34-39be-404d-b96a-a915c080f0f6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:11.175134 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-385a1c34-39be-404d-b96a-a915c080f0f6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1294 microversion: 2.1 time: 0.105131 May 12 09:34:11.176009 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 47/79] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:11 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:11.405879 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2944b250-eea2-43bf-8f81-3837b811a73b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:11.406748 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2944b250-eea2-43bf-8f81-3837b811a73b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:11.415491 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2944b250-eea2-43bf-8f81-3837b811a73b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:11.415491 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2944b250-eea2-43bf-8f81-3837b811a73b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:11.415491 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2944b250-eea2-43bf-8f81-3837b811a73b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:11.415491 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2944b250-eea2-43bf-8f81-3837b811a73b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:11.438706 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-61838590-0214-4fa4-b0e9-8678084912b7 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:11.439321 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-61838590-0214-4fa4-b0e9-8678084912b7 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:11.448135 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61838590-0214-4fa4-b0e9-8678084912b7 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:11.448588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61838590-0214-4fa4-b0e9-8678084912b7 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:11.449378 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61838590-0214-4fa4-b0e9-8678084912b7 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:11.450208 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61838590-0214-4fa4-b0e9-8678084912b7 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:11.499697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2944b250-eea2-43bf-8f81-3837b811a73b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:11.512291 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2944b250-eea2-43bf-8f81-3837b811a73b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1226 microversion: 2.1 time: 0.110087 May 12 09:34:11.513009 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 33/80] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:11 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1226 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:11.593991 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d8cc31c5-d2cb-40f7-84b0-087ecd282649 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:11.594601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d8cc31c5-d2cb-40f7-84b0-087ecd282649 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:11.598450 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-61838590-0214-4fa4-b0e9-8678084912b7 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:11.600707 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d8cc31c5-d2cb-40f7-84b0-087ecd282649 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:11.601205 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d8cc31c5-d2cb-40f7-84b0-087ecd282649 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:11.602095 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d8cc31c5-d2cb-40f7-84b0-087ecd282649 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:11.602418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d8cc31c5-d2cb-40f7-84b0-087ecd282649 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:11.606240 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-61838590-0214-4fa4-b0e9-8678084912b7 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.171317 May 12 09:34:11.606811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 48/81] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:11 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:11.671238 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d8cc31c5-d2cb-40f7-84b0-087ecd282649 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:11.680327 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d8cc31c5-d2cb-40f7-84b0-087ecd282649 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1241 microversion: 2.1 time: 0.089938 May 12 09:34:11.681181 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 34/82] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:11 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:12.194617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-dd13b3cd-d8d8-4d6d-bb6b-fbc56f689801 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:12.195881 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-dd13b3cd-d8d8-4d6d-bb6b-fbc56f689801 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:12.203986 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dd13b3cd-d8d8-4d6d-bb6b-fbc56f689801 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:12.204771 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dd13b3cd-d8d8-4d6d-bb6b-fbc56f689801 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:12.205719 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dd13b3cd-d8d8-4d6d-bb6b-fbc56f689801 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:12.206310 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dd13b3cd-d8d8-4d6d-bb6b-fbc56f689801 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:12.323967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-dd13b3cd-d8d8-4d6d-bb6b-fbc56f689801 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:12.332204 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-dd13b3cd-d8d8-4d6d-bb6b-fbc56f689801 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1294 microversion: 2.1 time: 0.142563 May 12 09:34:12.332780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 49/83] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:12 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:12.529508 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5533655a-159c-4877-9a89-2347606c7cbe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:12.530773 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5533655a-159c-4877-9a89-2347606c7cbe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:12.541759 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5533655a-159c-4877-9a89-2347606c7cbe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:12.542221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5533655a-159c-4877-9a89-2347606c7cbe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:12.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5533655a-159c-4877-9a89-2347606c7cbe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:12.544928 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5533655a-159c-4877-9a89-2347606c7cbe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:12.622154 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5533655a-159c-4877-9a89-2347606c7cbe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:12.625285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d98af670-d33c-48d7-841c-0f1b5a51636d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:12.625933 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d98af670-d33c-48d7-841c-0f1b5a51636d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:12.629522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5533655a-159c-4877-9a89-2347606c7cbe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1226 microversion: 2.1 time: 0.104220 May 12 09:34:12.632083 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 35/84] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:12 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:12.645858 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d98af670-d33c-48d7-841c-0f1b5a51636d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:12.647215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d98af670-d33c-48d7-841c-0f1b5a51636d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:12.648839 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d98af670-d33c-48d7-841c-0f1b5a51636d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:12.651769 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d98af670-d33c-48d7-841c-0f1b5a51636d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:12.697556 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0d10af2b-1706-4606-a76f-469ae0f1210b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:12.698630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0d10af2b-1706-4606-a76f-469ae0f1210b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:12.706964 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0d10af2b-1706-4606-a76f-469ae0f1210b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:12.707252 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0d10af2b-1706-4606-a76f-469ae0f1210b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:12.708649 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0d10af2b-1706-4606-a76f-469ae0f1210b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:12.708649 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0d10af2b-1706-4606-a76f-469ae0f1210b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:12.833222 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0d10af2b-1706-4606-a76f-469ae0f1210b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:12.847225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0d10af2b-1706-4606-a76f-469ae0f1210b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1241 microversion: 2.1 time: 0.154373 May 12 09:34:12.848170 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 36/85] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:12 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:12.874833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d98af670-d33c-48d7-841c-0f1b5a51636d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:12.885062 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d98af670-d33c-48d7-841c-0f1b5a51636d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.264055 May 12 09:34:12.885958 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 50/86] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:12 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:13.348598 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-df38eb62-a008-4fc8-9dd2-8e8000caf88c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:13.349203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-df38eb62-a008-4fc8-9dd2-8e8000caf88c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:13.356494 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-df38eb62-a008-4fc8-9dd2-8e8000caf88c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:13.357534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-df38eb62-a008-4fc8-9dd2-8e8000caf88c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:13.358381 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-df38eb62-a008-4fc8-9dd2-8e8000caf88c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:13.358816 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-df38eb62-a008-4fc8-9dd2-8e8000caf88c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:13.427064 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-df38eb62-a008-4fc8-9dd2-8e8000caf88c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:13.436126 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-df38eb62-a008-4fc8-9dd2-8e8000caf88c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1294 microversion: 2.1 time: 0.091075 May 12 09:34:13.446499 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 37/87] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:13 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:13.649425 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4782c9af-f295-4be0-9daf-91adc4737b63 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:13.650269 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4782c9af-f295-4be0-9daf-91adc4737b63 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:13.658305 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4782c9af-f295-4be0-9daf-91adc4737b63 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:13.659007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4782c9af-f295-4be0-9daf-91adc4737b63 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:13.660072 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4782c9af-f295-4be0-9daf-91adc4737b63 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:13.661053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4782c9af-f295-4be0-9daf-91adc4737b63 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:13.747666 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4782c9af-f295-4be0-9daf-91adc4737b63 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:13.756508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4782c9af-f295-4be0-9daf-91adc4737b63 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1226 microversion: 2.1 time: 0.111178 May 12 09:34:13.759264 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 51/88] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:13 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:13.864330 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2fca9484-278c-4e38-bf84-c95477b31ec6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:13.865023 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2fca9484-278c-4e38-bf84-c95477b31ec6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:13.870994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2fca9484-278c-4e38-bf84-c95477b31ec6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:13.871438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2fca9484-278c-4e38-bf84-c95477b31ec6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:13.872340 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2fca9484-278c-4e38-bf84-c95477b31ec6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:13.872775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2fca9484-278c-4e38-bf84-c95477b31ec6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:13.903498 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ef6e7f54-7c98-4d94-b23f-e05080d20eed tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:13.905272 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ef6e7f54-7c98-4d94-b23f-e05080d20eed tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:13.925643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ef6e7f54-7c98-4d94-b23f-e05080d20eed tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:13.926128 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ef6e7f54-7c98-4d94-b23f-e05080d20eed tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:13.930391 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ef6e7f54-7c98-4d94-b23f-e05080d20eed tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:13.934508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ef6e7f54-7c98-4d94-b23f-e05080d20eed tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:13.967613 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2fca9484-278c-4e38-bf84-c95477b31ec6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:13.979399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2fca9484-278c-4e38-bf84-c95477b31ec6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1241 microversion: 2.1 time: 0.118741 May 12 09:34:13.990316 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 38/89] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:13 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:14.240036 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ef6e7f54-7c98-4d94-b23f-e05080d20eed tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:14.248302 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ef6e7f54-7c98-4d94-b23f-e05080d20eed tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.350300 May 12 09:34:14.249267 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 52/90] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:13 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:14.452380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f9711959-07c2-43cb-a4ee-59f0f0fa90da tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:14.452982 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f9711959-07c2-43cb-a4ee-59f0f0fa90da tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:14.458669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f9711959-07c2-43cb-a4ee-59f0f0fa90da tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:14.459133 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f9711959-07c2-43cb-a4ee-59f0f0fa90da tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:14.459877 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f9711959-07c2-43cb-a4ee-59f0f0fa90da tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:14.460824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f9711959-07c2-43cb-a4ee-59f0f0fa90da tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:14.527996 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f9711959-07c2-43cb-a4ee-59f0f0fa90da tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:14.535475 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f9711959-07c2-43cb-a4ee-59f0f0fa90da tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1294 microversion: 2.1 time: 0.086864 May 12 09:34:14.536043 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 39/91] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:14 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:14.774672 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f1502be4-16f4-4b64-88ce-a449897347d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:14.775285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f1502be4-16f4-4b64-88ce-a449897347d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:14.781239 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f1502be4-16f4-4b64-88ce-a449897347d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:14.781695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f1502be4-16f4-4b64-88ce-a449897347d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:14.782530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f1502be4-16f4-4b64-88ce-a449897347d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:14.782962 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f1502be4-16f4-4b64-88ce-a449897347d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:14.847590 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f1502be4-16f4-4b64-88ce-a449897347d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:14.855220 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f1502be4-16f4-4b64-88ce-a449897347d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1226 microversion: 2.1 time: 0.085022 May 12 09:34:14.855797 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 53/92] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:14 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:14.999008 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e424327c-7dee-4d45-915f-55023d37dcc6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:14.999724 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e424327c-7dee-4d45-915f-55023d37dcc6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:15.006874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e424327c-7dee-4d45-915f-55023d37dcc6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:15.008280 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e424327c-7dee-4d45-915f-55023d37dcc6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:15.009318 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e424327c-7dee-4d45-915f-55023d37dcc6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:15.009753 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e424327c-7dee-4d45-915f-55023d37dcc6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:15.077648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e424327c-7dee-4d45-915f-55023d37dcc6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:15.084849 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e424327c-7dee-4d45-915f-55023d37dcc6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1241 microversion: 2.1 time: 0.090448 May 12 09:34:15.085476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 40/93] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:14 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:15.265200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cce98087-ff04-4e8d-a366-7ad8f56e0e1a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:15.265665 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cce98087-ff04-4e8d-a366-7ad8f56e0e1a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:15.271709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cce98087-ff04-4e8d-a366-7ad8f56e0e1a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:15.272166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cce98087-ff04-4e8d-a366-7ad8f56e0e1a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:15.272935 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cce98087-ff04-4e8d-a366-7ad8f56e0e1a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:15.273359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cce98087-ff04-4e8d-a366-7ad8f56e0e1a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:15.454465 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-cce98087-ff04-4e8d-a366-7ad8f56e0e1a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:15.462349 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cce98087-ff04-4e8d-a366-7ad8f56e0e1a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.201032 May 12 09:34:15.462911 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 54/94] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:15 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:15.555593 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-bcba2cff-a799-437e-9290-584c15493b7d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:15.556808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-bcba2cff-a799-437e-9290-584c15493b7d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:15.562880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bcba2cff-a799-437e-9290-584c15493b7d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:15.563328 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bcba2cff-a799-437e-9290-584c15493b7d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:15.564092 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bcba2cff-a799-437e-9290-584c15493b7d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:15.564582 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bcba2cff-a799-437e-9290-584c15493b7d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:15.642632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-bcba2cff-a799-437e-9290-584c15493b7d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:15.651533 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-bcba2cff-a799-437e-9290-584c15493b7d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1294 microversion: 2.1 time: 0.100360 May 12 09:34:15.653265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 41/95] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:15 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:15.872729 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6acfc8d7-dc04-4cfe-8787-ee46bff0d35d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:15.873338 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6acfc8d7-dc04-4cfe-8787-ee46bff0d35d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:15.879160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6acfc8d7-dc04-4cfe-8787-ee46bff0d35d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:15.879611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6acfc8d7-dc04-4cfe-8787-ee46bff0d35d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:15.880375 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6acfc8d7-dc04-4cfe-8787-ee46bff0d35d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:15.880815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6acfc8d7-dc04-4cfe-8787-ee46bff0d35d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:15.966817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6acfc8d7-dc04-4cfe-8787-ee46bff0d35d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:15.974308 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6acfc8d7-dc04-4cfe-8787-ee46bff0d35d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1226 microversion: 2.1 time: 0.105498 May 12 09:34:15.984465 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 55/96] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:15 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:16.111742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-866ebbe1-68c4-4536-8a22-58c8a4fdc7f4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:16.112394 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-866ebbe1-68c4-4536-8a22-58c8a4fdc7f4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:16.133191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-866ebbe1-68c4-4536-8a22-58c8a4fdc7f4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:16.138620 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-866ebbe1-68c4-4536-8a22-58c8a4fdc7f4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:16.139525 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-866ebbe1-68c4-4536-8a22-58c8a4fdc7f4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:16.139967 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-866ebbe1-68c4-4536-8a22-58c8a4fdc7f4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:16.266833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-866ebbe1-68c4-4536-8a22-58c8a4fdc7f4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:16.279706 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-866ebbe1-68c4-4536-8a22-58c8a4fdc7f4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1233 microversion: 2.1 time: 0.178912 May 12 09:34:16.281783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 42/97] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:16 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1233 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:16.480242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e3c6a9a3-c873-40d6-aba4-7ab510085f7c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:16.480854 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e3c6a9a3-c873-40d6-aba4-7ab510085f7c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:16.490812 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3c6a9a3-c873-40d6-aba4-7ab510085f7c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:16.491274 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3c6a9a3-c873-40d6-aba4-7ab510085f7c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:16.495421 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3c6a9a3-c873-40d6-aba4-7ab510085f7c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:16.495894 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3c6a9a3-c873-40d6-aba4-7ab510085f7c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:16.670283 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-262f4ca1-07df-4a86-b32d-1fe3e92819f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:16.671264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-262f4ca1-07df-4a86-b32d-1fe3e92819f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:16.684152 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-262f4ca1-07df-4a86-b32d-1fe3e92819f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:16.684640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-262f4ca1-07df-4a86-b32d-1fe3e92819f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:16.693714 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-262f4ca1-07df-4a86-b32d-1fe3e92819f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:16.696428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-262f4ca1-07df-4a86-b32d-1fe3e92819f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:16.754748 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e3c6a9a3-c873-40d6-aba4-7ab510085f7c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:16.769762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e3c6a9a3-c873-40d6-aba4-7ab510085f7c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.294094 May 12 09:34:16.780378 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 56/98] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:16 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:16.878211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-262f4ca1-07df-4a86-b32d-1fe3e92819f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:16.890281 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-262f4ca1-07df-4a86-b32d-1fe3e92819f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1302 microversion: 2.1 time: 0.225395 May 12 09:34:16.891085 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 43/99] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:16 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1302 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:16.992757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4942cc2f-db09-40af-8ea8-beb766ae6c31 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:16.993450 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4942cc2f-db09-40af-8ea8-beb766ae6c31 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:17.004876 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4942cc2f-db09-40af-8ea8-beb766ae6c31 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:17.007195 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4942cc2f-db09-40af-8ea8-beb766ae6c31 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:17.009189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4942cc2f-db09-40af-8ea8-beb766ae6c31 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:17.010922 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4942cc2f-db09-40af-8ea8-beb766ae6c31 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:17.130491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4942cc2f-db09-40af-8ea8-beb766ae6c31 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:17.153649 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4942cc2f-db09-40af-8ea8-beb766ae6c31 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1274 microversion: 2.1 time: 0.165099 May 12 09:34:17.155389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 57/100] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:16 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1274 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:17.296711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b8293f11-f945-4c48-b655-4d9170ba8066 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:17.297323 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b8293f11-f945-4c48-b655-4d9170ba8066 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:17.306098 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b8293f11-f945-4c48-b655-4d9170ba8066 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:17.306550 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b8293f11-f945-4c48-b655-4d9170ba8066 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:17.307337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b8293f11-f945-4c48-b655-4d9170ba8066 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:17.307938 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b8293f11-f945-4c48-b655-4d9170ba8066 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:17.394450 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b8293f11-f945-4c48-b655-4d9170ba8066 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:17.415591 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b8293f11-f945-4c48-b655-4d9170ba8066 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1297 microversion: 2.1 time: 0.122598 May 12 09:34:17.418470 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 44/101] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:17 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:17.785932 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9fc333fc-0e8b-4396-a613-e69035bc4750 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:17.786730 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9fc333fc-0e8b-4396-a613-e69035bc4750 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:17.796162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9fc333fc-0e8b-4396-a613-e69035bc4750 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:17.796610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9fc333fc-0e8b-4396-a613-e69035bc4750 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:17.797552 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9fc333fc-0e8b-4396-a613-e69035bc4750 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:17.798058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9fc333fc-0e8b-4396-a613-e69035bc4750 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:17.907328 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-31f43541-963e-412d-890f-c0897178cf6b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:17.908538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-31f43541-963e-412d-890f-c0897178cf6b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:17.919547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31f43541-963e-412d-890f-c0897178cf6b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:17.922245 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31f43541-963e-412d-890f-c0897178cf6b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:17.923257 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31f43541-963e-412d-890f-c0897178cf6b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:17.925418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31f43541-963e-412d-890f-c0897178cf6b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:18.120902 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-31f43541-963e-412d-890f-c0897178cf6b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:18.129315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-31f43541-963e-412d-890f-c0897178cf6b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1300 microversion: 2.1 time: 0.225669 May 12 09:34:18.138263 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 45/102] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:17 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1300 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:18.173920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-bedc1d03-7222-47b5-8062-377a74700f0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:18.175374 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-bedc1d03-7222-47b5-8062-377a74700f0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:18.191956 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bedc1d03-7222-47b5-8062-377a74700f0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:18.192575 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bedc1d03-7222-47b5-8062-377a74700f0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:18.193713 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bedc1d03-7222-47b5-8062-377a74700f0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:18.194334 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bedc1d03-7222-47b5-8062-377a74700f0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:18.356269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-bedc1d03-7222-47b5-8062-377a74700f0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:18.363551 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-bedc1d03-7222-47b5-8062-377a74700f0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1280 microversion: 2.1 time: 0.193792 May 12 09:34:18.374251 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 46/103] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:18 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:18.410864 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9fc333fc-0e8b-4396-a613-e69035bc4750 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:18.424576 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9fc333fc-0e8b-4396-a613-e69035bc4750 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.642348 May 12 09:34:18.439867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ef44381c-8b18-4360-8bfb-1e46d5927f18 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:18.440788 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ef44381c-8b18-4360-8bfb-1e46d5927f18 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:18.445930 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 58/104] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:17 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:18.447682 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ef44381c-8b18-4360-8bfb-1e46d5927f18 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:18.448365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ef44381c-8b18-4360-8bfb-1e46d5927f18 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:18.449507 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ef44381c-8b18-4360-8bfb-1e46d5927f18 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:18.450069 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ef44381c-8b18-4360-8bfb-1e46d5927f18 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:18.590158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ef44381c-8b18-4360-8bfb-1e46d5927f18 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:18.600734 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ef44381c-8b18-4360-8bfb-1e46d5927f18 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1295 microversion: 2.1 time: 0.164582 May 12 09:34:18.604522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 47/105] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:18 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1295 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:19.147355 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6b3cf8e7-1a33-4c2a-a4aa-ff435136c6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:19.147999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6b3cf8e7-1a33-4c2a-a4aa-ff435136c6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:19.157389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6b3cf8e7-1a33-4c2a-a4aa-ff435136c6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:19.158115 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6b3cf8e7-1a33-4c2a-a4aa-ff435136c6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:19.159052 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6b3cf8e7-1a33-4c2a-a4aa-ff435136c6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:19.165751 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6b3cf8e7-1a33-4c2a-a4aa-ff435136c6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:19.383785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3a077a2e-90a8-496e-be2c-049c2ae47892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:19.385651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3a077a2e-90a8-496e-be2c-049c2ae47892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:19.397207 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3a077a2e-90a8-496e-be2c-049c2ae47892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:19.399264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3a077a2e-90a8-496e-be2c-049c2ae47892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:19.400080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3a077a2e-90a8-496e-be2c-049c2ae47892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:19.400524 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3a077a2e-90a8-496e-be2c-049c2ae47892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:19.556919 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-3a077a2e-90a8-496e-be2c-049c2ae47892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:19.565721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3a077a2e-90a8-496e-be2c-049c2ae47892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1280 microversion: 2.1 time: 0.186877 May 12 09:34:19.566593 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 48/106] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:19 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:19.575342 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9a41bf12-6fb0-4d27-9179-75eab12ae03d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:19.576728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9a41bf12-6fb0-4d27-9179-75eab12ae03d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:19.585588 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a41bf12-6fb0-4d27-9179-75eab12ae03d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:19.586433 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a41bf12-6fb0-4d27-9179-75eab12ae03d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:19.587716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a41bf12-6fb0-4d27-9179-75eab12ae03d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:19.588428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a41bf12-6fb0-4d27-9179-75eab12ae03d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:19.628977 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6b3cf8e7-1a33-4c2a-a4aa-ff435136c6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:19.637422 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6b3cf8e7-1a33-4c2a-a4aa-ff435136c6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.493816 May 12 09:34:19.638081 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 59/107] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:19 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:19.658486 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d24c964f-59fa-4b87-adc2-7986810b1067 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:19.662743 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d24c964f-59fa-4b87-adc2-7986810b1067 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:19.681707 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d24c964f-59fa-4b87-adc2-7986810b1067 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:19.682261 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d24c964f-59fa-4b87-adc2-7986810b1067 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:19.683048 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d24c964f-59fa-4b87-adc2-7986810b1067 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:19.684636 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d24c964f-59fa-4b87-adc2-7986810b1067 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:20.035315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9a41bf12-6fb0-4d27-9179-75eab12ae03d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:20.048103 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9a41bf12-6fb0-4d27-9179-75eab12ae03d tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.478098 May 12 09:34:20.050195 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 49/108] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:19 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:20.080338 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d24c964f-59fa-4b87-adc2-7986810b1067 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:20.108575 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d24c964f-59fa-4b87-adc2-7986810b1067 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.464485 May 12 09:34:20.109488 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 60/109] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:19 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:20.583802 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ddadb36e-a7d0-411b-b6c5-559b92163e60 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:20.584751 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ddadb36e-a7d0-411b-b6c5-559b92163e60 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:20.595046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ddadb36e-a7d0-411b-b6c5-559b92163e60 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:20.595046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ddadb36e-a7d0-411b-b6c5-559b92163e60 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:20.595817 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ddadb36e-a7d0-411b-b6c5-559b92163e60 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:20.597260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ddadb36e-a7d0-411b-b6c5-559b92163e60 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:20.655099 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-dbac8e13-c9fd-4e05-84eb-b60981b6665d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:20.656081 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-dbac8e13-c9fd-4e05-84eb-b60981b6665d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:20.663077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dbac8e13-c9fd-4e05-84eb-b60981b6665d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:20.664107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dbac8e13-c9fd-4e05-84eb-b60981b6665d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:20.666663 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dbac8e13-c9fd-4e05-84eb-b60981b6665d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:20.667267 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dbac8e13-c9fd-4e05-84eb-b60981b6665d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:20.847077 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ddadb36e-a7d0-411b-b6c5-559b92163e60 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:20.854547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ddadb36e-a7d0-411b-b6c5-559b92163e60 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1280 microversion: 2.1 time: 0.274872 May 12 09:34:20.862565 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 50/110] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:20 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:20.994985 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-dbac8e13-c9fd-4e05-84eb-b60981b6665d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:21.004010 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-dbac8e13-c9fd-4e05-84eb-b60981b6665d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.352646 May 12 09:34:21.005704 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 61/111] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:20 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:21.065833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-01cbd15b-4342-4bd7-9349-94f2a0e2ecf3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:21.066335 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-01cbd15b-4342-4bd7-9349-94f2a0e2ecf3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:21.076051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-01cbd15b-4342-4bd7-9349-94f2a0e2ecf3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:21.076504 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-01cbd15b-4342-4bd7-9349-94f2a0e2ecf3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:21.077282 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-01cbd15b-4342-4bd7-9349-94f2a0e2ecf3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:21.080395 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-01cbd15b-4342-4bd7-9349-94f2a0e2ecf3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:21.126851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-92d9e7e1-21e4-40a8-8307-091c5f3c3473 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:21.127726 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-92d9e7e1-21e4-40a8-8307-091c5f3c3473 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:21.143338 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-92d9e7e1-21e4-40a8-8307-091c5f3c3473 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:21.144624 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-92d9e7e1-21e4-40a8-8307-091c5f3c3473 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:21.146032 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-92d9e7e1-21e4-40a8-8307-091c5f3c3473 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:21.148120 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-92d9e7e1-21e4-40a8-8307-091c5f3c3473 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:21.391119 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-01cbd15b-4342-4bd7-9349-94f2a0e2ecf3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:21.398843 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-01cbd15b-4342-4bd7-9349-94f2a0e2ecf3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.337071 May 12 09:34:21.399414 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 51/112] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:21 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:21.426310 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-92d9e7e1-21e4-40a8-8307-091c5f3c3473 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:21.435126 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-92d9e7e1-21e4-40a8-8307-091c5f3c3473 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.311892 May 12 09:34:21.435876 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 62/113] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:21 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:21.875161 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2c00fccd-c626-47e2-b2b5-218e05216de8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:21.876394 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2c00fccd-c626-47e2-b2b5-218e05216de8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:21.890609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2c00fccd-c626-47e2-b2b5-218e05216de8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:21.891490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2c00fccd-c626-47e2-b2b5-218e05216de8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:21.894880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2c00fccd-c626-47e2-b2b5-218e05216de8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:21.896572 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2c00fccd-c626-47e2-b2b5-218e05216de8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:22.037092 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-069f0a2c-1e54-43c3-ba06-96e646e9fb9b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:22.039357 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-069f0a2c-1e54-43c3-ba06-96e646e9fb9b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:22.056152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-069f0a2c-1e54-43c3-ba06-96e646e9fb9b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:22.056976 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-069f0a2c-1e54-43c3-ba06-96e646e9fb9b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:22.059252 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-069f0a2c-1e54-43c3-ba06-96e646e9fb9b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:22.059845 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-069f0a2c-1e54-43c3-ba06-96e646e9fb9b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:22.457214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2c00fccd-c626-47e2-b2b5-218e05216de8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:22.466013 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2c00fccd-c626-47e2-b2b5-218e05216de8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.595007 May 12 09:34:22.471284 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 52/114] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:21 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:22.480610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-db6139f8-a75b-4e90-90ce-2b98fa77c0bc tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:22.485215 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-db6139f8-a75b-4e90-90ce-2b98fa77c0bc tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:22.500815 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-db6139f8-a75b-4e90-90ce-2b98fa77c0bc tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:22.504345 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-db6139f8-a75b-4e90-90ce-2b98fa77c0bc tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:22.505440 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-db6139f8-a75b-4e90-90ce-2b98fa77c0bc tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:22.508043 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-db6139f8-a75b-4e90-90ce-2b98fa77c0bc tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:22.997156 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-069f0a2c-1e54-43c3-ba06-96e646e9fb9b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:23.010182 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-069f0a2c-1e54-43c3-ba06-96e646e9fb9b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.987651 May 12 09:34:23.013658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 63/115] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:22 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:23.026358 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3fa290dc-9494-4987-a0fe-e889a180d4d5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:23.029774 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3fa290dc-9494-4987-a0fe-e889a180d4d5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:23.052750 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3fa290dc-9494-4987-a0fe-e889a180d4d5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:23.053343 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3fa290dc-9494-4987-a0fe-e889a180d4d5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:23.057922 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3fa290dc-9494-4987-a0fe-e889a180d4d5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:23.058387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3fa290dc-9494-4987-a0fe-e889a180d4d5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:23.632669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-db6139f8-a75b-4e90-90ce-2b98fa77c0bc tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:23.648428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-db6139f8-a75b-4e90-90ce-2b98fa77c0bc tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 1.173382 May 12 09:34:23.657887 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 53/116] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:22 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:23.681208 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-487a33c8-9668-4e5f-8e34-445445ec310d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:23.681856 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-487a33c8-9668-4e5f-8e34-445445ec310d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:23.715927 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-487a33c8-9668-4e5f-8e34-445445ec310d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:23.718897 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-487a33c8-9668-4e5f-8e34-445445ec310d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:23.720841 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-487a33c8-9668-4e5f-8e34-445445ec310d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:23.724549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-487a33c8-9668-4e5f-8e34-445445ec310d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:24.304866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3fa290dc-9494-4987-a0fe-e889a180d4d5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:24.328043 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3fa290dc-9494-4987-a0fe-e889a180d4d5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 1.311515 May 12 09:34:24.334651 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 64/117] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:23 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:24.353866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-9cc60917-f95d-415f-916c-5e6dfa573993 req-d689e5a1-e57a-4190-8e91-c05d402dcff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed911f6-afdf-49e6-9897-e51a903b7680", "tag": "d8e31c88-6d60-467b-8eec-0d8851da1ced"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:24.364250 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-9cc60917-f95d-415f-916c-5e6dfa573993 req-d689e5a1-e57a-4190-8e91-c05d402dcff8 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:24.365057 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-9cc60917-f95d-415f-916c-5e6dfa573993 req-d689e5a1-e57a-4190-8e91-c05d402dcff8 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:24.404766 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-9cc60917-f95d-415f-916c-5e6dfa573993 req-d689e5a1-e57a-4190-8e91-c05d402dcff8 service nova] Creating event network-changed:d8e31c88-6d60-467b-8eec-0d8851da1ced for instance 4ed911f6-afdf-49e6-9897-e51a903b7680 on hv-cinder-83769 May 12 09:34:24.413749 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-9cc60917-f95d-415f-916c-5e6dfa573993 req-d689e5a1-e57a-4190-8e91-c05d402dcff8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072723 May 12 09:34:24.416195 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 65/118] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:24.423406 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ee3b68ff-3d89-4f69-b16c-584e1761964f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:24.424331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ee3b68ff-3d89-4f69-b16c-584e1761964f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:24.432316 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ee3b68ff-3d89-4f69-b16c-584e1761964f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:24.433617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ee3b68ff-3d89-4f69-b16c-584e1761964f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:24.434642 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ee3b68ff-3d89-4f69-b16c-584e1761964f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:24.436093 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ee3b68ff-3d89-4f69-b16c-584e1761964f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:25.076711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-487a33c8-9668-4e5f-8e34-445445ec310d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:25.087521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-487a33c8-9668-4e5f-8e34-445445ec310d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 1.427839 May 12 09:34:25.088443 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 54/119] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:23 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:25.100271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-44e32d44-e363-4d37-a924-abc28b4a5a44 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:25.101447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-44e32d44-e363-4d37-a924-abc28b4a5a44 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:25.113741 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-44e32d44-e363-4d37-a924-abc28b4a5a44 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:25.114262 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-44e32d44-e363-4d37-a924-abc28b4a5a44 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:25.115051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-44e32d44-e363-4d37-a924-abc28b4a5a44 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:25.115496 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-44e32d44-e363-4d37-a924-abc28b4a5a44 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:25.318811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ee3b68ff-3d89-4f69-b16c-584e1761964f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:25.327088 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ee3b68ff-3d89-4f69-b16c-584e1761964f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.909398 May 12 09:34:25.341713 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 66/120] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:24 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:25.521412 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-44e32d44-e363-4d37-a924-abc28b4a5a44 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:25.532198 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-44e32d44-e363-4d37-a924-abc28b4a5a44 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.440800 May 12 09:34:25.537349 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 55/121] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:25 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:25.543992 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7835723a-c941-4023-8452-1fb95bbda562 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:25.547790 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7835723a-c941-4023-8452-1fb95bbda562 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:25.560780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-5bb2f162-7d1f-4fe8-8353-bf0f1777a5be req-e6e246fd-be8b-480a-ad3a-e101fa353003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc90e8c3-13f2-4b3e-91e8-396847cf6572", "tag": "332c08c8-a0fb-4e00-b6b4-9b038555668c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:25.583220 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7835723a-c941-4023-8452-1fb95bbda562 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:25.583822 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7835723a-c941-4023-8452-1fb95bbda562 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:25.584475 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7835723a-c941-4023-8452-1fb95bbda562 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:25.585954 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7835723a-c941-4023-8452-1fb95bbda562 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:25.590833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-5bb2f162-7d1f-4fe8-8353-bf0f1777a5be req-e6e246fd-be8b-480a-ad3a-e101fa353003 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:25.591276 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-5bb2f162-7d1f-4fe8-8353-bf0f1777a5be req-e6e246fd-be8b-480a-ad3a-e101fa353003 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:25.620034 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-5bb2f162-7d1f-4fe8-8353-bf0f1777a5be req-e6e246fd-be8b-480a-ad3a-e101fa353003 service nova] Creating event network-changed:332c08c8-a0fb-4e00-b6b4-9b038555668c for instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 on hv-cinder-83769 May 12 09:34:25.643232 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-5bb2f162-7d1f-4fe8-8353-bf0f1777a5be req-e6e246fd-be8b-480a-ad3a-e101fa353003 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294533 May 12 09:34:25.646131 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 67/122] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:25.969889 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-815c7cf5-d271-4b9f-ac9f-949c844b4128 req-dc43444f-fa63-48d0-a1ca-9596b354f65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b658c976-df06-49bb-9c2d-4d42cead8156", "name": "network-vif-plugged", "status": "completed", "tag": "a1f179d2-9260-4805-a962-5a7091a5b50a"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:25.989685 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-815c7cf5-d271-4b9f-ac9f-949c844b4128 req-dc43444f-fa63-48d0-a1ca-9596b354f65a service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:25.990166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-815c7cf5-d271-4b9f-ac9f-949c844b4128 req-dc43444f-fa63-48d0-a1ca-9596b354f65a service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:26.017633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-815c7cf5-d271-4b9f-ac9f-949c844b4128 req-dc43444f-fa63-48d0-a1ca-9596b354f65a service nova] Creating event network-vif-plugged:a1f179d2-9260-4805-a962-5a7091a5b50a for instance b658c976-df06-49bb-9c2d-4d42cead8156 on hv-cinder-83769 May 12 09:34:26.031687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-815c7cf5-d271-4b9f-ac9f-949c844b4128 req-dc43444f-fa63-48d0-a1ca-9596b354f65a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187258 May 12 09:34:26.032377 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 68/123] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:34:26.107188 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-66efc652-d0da-40ca-9e9b-2aecd36dd848 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:26.108150 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-66efc652-d0da-40ca-9e9b-2aecd36dd848 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:26.118538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-66efc652-d0da-40ca-9e9b-2aecd36dd848 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:26.119255 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-66efc652-d0da-40ca-9e9b-2aecd36dd848 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:26.120416 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-66efc652-d0da-40ca-9e9b-2aecd36dd848 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:26.121132 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-66efc652-d0da-40ca-9e9b-2aecd36dd848 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:26.340795 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7835723a-c941-4023-8452-1fb95bbda562 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:26.351489 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7835723a-c941-4023-8452-1fb95bbda562 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.812291 May 12 09:34:26.352060 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 56/124] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:25 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:26.357170 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9bec4d02-14b6-419c-aa59-926ed744e8e6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:26.358354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9bec4d02-14b6-419c-aa59-926ed744e8e6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:26.364427 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9bec4d02-14b6-419c-aa59-926ed744e8e6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:26.365071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9bec4d02-14b6-419c-aa59-926ed744e8e6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:26.365967 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9bec4d02-14b6-419c-aa59-926ed744e8e6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:26.366998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9bec4d02-14b6-419c-aa59-926ed744e8e6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:26.509954 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-66efc652-d0da-40ca-9e9b-2aecd36dd848 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:26.517371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-66efc652-d0da-40ca-9e9b-2aecd36dd848 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.416907 May 12 09:34:26.517958 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 69/125] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:26 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:26.526113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-f1dd6488-afaf-4a8d-9d51-2eea4aaf571d req-b4eda680-8ec3-4b00-9bb3-66370c5115e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dadb998-7d24-461d-bf2f-cec5ab30fb48", "tag": "c4a1fbd1-1e2f-4367-8cd0-c2f3b5182c2b"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:26.530339 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f1dd6488-afaf-4a8d-9d51-2eea4aaf571d req-b4eda680-8ec3-4b00-9bb3-66370c5115e0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:26.530793 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f1dd6488-afaf-4a8d-9d51-2eea4aaf571d req-b4eda680-8ec3-4b00-9bb3-66370c5115e0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:26.542533 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-f1dd6488-afaf-4a8d-9d51-2eea4aaf571d req-b4eda680-8ec3-4b00-9bb3-66370c5115e0 service nova] Creating event network-changed:c4a1fbd1-1e2f-4367-8cd0-c2f3b5182c2b for instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 on hv-cinder-83769 May 12 09:34:26.556725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-f1dd6488-afaf-4a8d-9d51-2eea4aaf571d req-b4eda680-8ec3-4b00-9bb3-66370c5115e0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037556 May 12 09:34:26.557504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 70/126] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:26.574691 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-14267f80-3023-4bcc-abd0-a571883619b5 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:26.575403 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-14267f80-3023-4bcc-abd0-a571883619b5 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:26.585750 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-14267f80-3023-4bcc-abd0-a571883619b5 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:26.586337 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-14267f80-3023-4bcc-abd0-a571883619b5 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:26.587149 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-14267f80-3023-4bcc-abd0-a571883619b5 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:26.587732 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-14267f80-3023-4bcc-abd0-a571883619b5 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:26.657974 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9bec4d02-14b6-419c-aa59-926ed744e8e6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:26.666709 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9bec4d02-14b6-419c-aa59-926ed744e8e6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.313312 May 12 09:34:26.667538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 57/127] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:26 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:26.772550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-14267f80-3023-4bcc-abd0-a571883619b5 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:26.781723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-14267f80-3023-4bcc-abd0-a571883619b5 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.222455 May 12 09:34:26.782364 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 71/128] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:26 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:27.367629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4ab78a17-47a8-4fc5-be7f-fd98b5e41953 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:27.368799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4ab78a17-47a8-4fc5-be7f-fd98b5e41953 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:27.375921 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4ab78a17-47a8-4fc5-be7f-fd98b5e41953 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:27.376624 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4ab78a17-47a8-4fc5-be7f-fd98b5e41953 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:27.377607 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4ab78a17-47a8-4fc5-be7f-fd98b5e41953 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:27.378352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4ab78a17-47a8-4fc5-be7f-fd98b5e41953 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:27.528874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4ab78a17-47a8-4fc5-be7f-fd98b5e41953 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:27.534659 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a0fc55cb-22ad-4f6a-a85a-9ffe0b88d3cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:27.535679 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a0fc55cb-22ad-4f6a-a85a-9ffe0b88d3cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:27.536741 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4ab78a17-47a8-4fc5-be7f-fd98b5e41953 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.173154 May 12 09:34:27.543903 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0fc55cb-22ad-4f6a-a85a-9ffe0b88d3cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:27.544441 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0fc55cb-22ad-4f6a-a85a-9ffe0b88d3cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:27.545424 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0fc55cb-22ad-4f6a-a85a-9ffe0b88d3cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:27.546041 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0fc55cb-22ad-4f6a-a85a-9ffe0b88d3cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:27.549066 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 58/129] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:27 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:27.685048 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-aeea53cb-36fb-4d03-802c-f9bf2b276ca9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:27.686377 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-aeea53cb-36fb-4d03-802c-f9bf2b276ca9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:27.699859 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-aeea53cb-36fb-4d03-802c-f9bf2b276ca9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:27.701030 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-aeea53cb-36fb-4d03-802c-f9bf2b276ca9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:27.702151 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-aeea53cb-36fb-4d03-802c-f9bf2b276ca9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:27.702940 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-aeea53cb-36fb-4d03-802c-f9bf2b276ca9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:27.713359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a0fc55cb-22ad-4f6a-a85a-9ffe0b88d3cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:27.721645 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a0fc55cb-22ad-4f6a-a85a-9ffe0b88d3cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.189977 May 12 09:34:27.722317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 72/130] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:27 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:27.734408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-c024b9ed-7704-4de5-94c2-b52ba65ea2ab req-9b6ce2b6-6bcf-48b5-84cd-91a766819866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53d9ed2f-fe3d-46fc-a250-33724264ef93", "tag": "35189b62-b72a-41d7-be6e-95a6288505a1"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:27.744145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-c024b9ed-7704-4de5-94c2-b52ba65ea2ab req-9b6ce2b6-6bcf-48b5-84cd-91a766819866 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:27.744959 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-c024b9ed-7704-4de5-94c2-b52ba65ea2ab req-9b6ce2b6-6bcf-48b5-84cd-91a766819866 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:27.764466 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-c024b9ed-7704-4de5-94c2-b52ba65ea2ab req-9b6ce2b6-6bcf-48b5-84cd-91a766819866 service nova] Creating event network-changed:35189b62-b72a-41d7-be6e-95a6288505a1 for instance 53d9ed2f-fe3d-46fc-a250-33724264ef93 on hv-cinder-83769 May 12 09:34:27.772486 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-c024b9ed-7704-4de5-94c2-b52ba65ea2ab req-9b6ce2b6-6bcf-48b5-84cd-91a766819866 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046828 May 12 09:34:27.773967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 73/131] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:27.805081 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e9798410-9b0b-4822-a04d-09b4349b9daa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:27.805861 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e9798410-9b0b-4822-a04d-09b4349b9daa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:27.812092 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9798410-9b0b-4822-a04d-09b4349b9daa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:27.812780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9798410-9b0b-4822-a04d-09b4349b9daa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:27.813734 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9798410-9b0b-4822-a04d-09b4349b9daa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:27.814371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9798410-9b0b-4822-a04d-09b4349b9daa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:27.863539 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-aeea53cb-36fb-4d03-802c-f9bf2b276ca9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:27.871345 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-aeea53cb-36fb-4d03-802c-f9bf2b276ca9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.190924 May 12 09:34:27.872455 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 59/132] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:27 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:27.964078 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e9798410-9b0b-4822-a04d-09b4349b9daa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:27.971885 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e9798410-9b0b-4822-a04d-09b4349b9daa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.176275 May 12 09:34:27.974206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 74/133] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:27 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:28.557867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-39a9dfd4-fa8b-4e27-ae6f-f0aa2624d1a7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:28.559469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-39a9dfd4-fa8b-4e27-ae6f-f0aa2624d1a7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:28.565762 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-39a9dfd4-fa8b-4e27-ae6f-f0aa2624d1a7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:28.566536 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-39a9dfd4-fa8b-4e27-ae6f-f0aa2624d1a7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:28.567530 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-39a9dfd4-fa8b-4e27-ae6f-f0aa2624d1a7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:28.568165 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-39a9dfd4-fa8b-4e27-ae6f-f0aa2624d1a7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:28.740150 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3a428d32-42b4-43d4-b30e-b0180fb12f96 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:28.741657 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3a428d32-42b4-43d4-b30e-b0180fb12f96 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:28.750667 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3a428d32-42b4-43d4-b30e-b0180fb12f96 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:28.751132 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3a428d32-42b4-43d4-b30e-b0180fb12f96 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:28.751921 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3a428d32-42b4-43d4-b30e-b0180fb12f96 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:28.752369 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3a428d32-42b4-43d4-b30e-b0180fb12f96 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:28.807754 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-39a9dfd4-fa8b-4e27-ae6f-f0aa2624d1a7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:28.817322 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-39a9dfd4-fa8b-4e27-ae6f-f0aa2624d1a7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.265003 May 12 09:34:28.818287 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 60/134] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:28 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:28.890028 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8b0eda1c-eb16-4a15-9de8-f517c834089b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:28.890866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8b0eda1c-eb16-4a15-9de8-f517c834089b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:28.901419 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8b0eda1c-eb16-4a15-9de8-f517c834089b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:28.902005 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8b0eda1c-eb16-4a15-9de8-f517c834089b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:28.904163 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8b0eda1c-eb16-4a15-9de8-f517c834089b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:28.905946 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8b0eda1c-eb16-4a15-9de8-f517c834089b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:28.958768 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3a428d32-42b4-43d4-b30e-b0180fb12f96 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:28.970368 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3a428d32-42b4-43d4-b30e-b0180fb12f96 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.235015 May 12 09:34:28.972123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 75/135] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:28 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:28.992980 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2cc0803b-d0bf-4d6b-a88a-210c6919f580 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:28.994151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2cc0803b-d0bf-4d6b-a88a-210c6919f580 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:29.009407 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2cc0803b-d0bf-4d6b-a88a-210c6919f580 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:29.011338 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2cc0803b-d0bf-4d6b-a88a-210c6919f580 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:29.012349 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2cc0803b-d0bf-4d6b-a88a-210c6919f580 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:29.014658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2cc0803b-d0bf-4d6b-a88a-210c6919f580 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:29.158502 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8b0eda1c-eb16-4a15-9de8-f517c834089b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:29.168889 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8b0eda1c-eb16-4a15-9de8-f517c834089b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.281141 May 12 09:34:29.171451 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 61/136] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:28 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:29.308155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2cc0803b-d0bf-4d6b-a88a-210c6919f580 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:29.326505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2cc0803b-d0bf-4d6b-a88a-210c6919f580 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.339478 May 12 09:34:29.338329 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 76/137] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:28 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:29.837650 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3756264f-55cf-4a1e-8052-dd9684a8baf8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:29.838446 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3756264f-55cf-4a1e-8052-dd9684a8baf8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:29.845530 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3756264f-55cf-4a1e-8052-dd9684a8baf8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:29.846185 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3756264f-55cf-4a1e-8052-dd9684a8baf8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:29.847091 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3756264f-55cf-4a1e-8052-dd9684a8baf8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:29.847521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3756264f-55cf-4a1e-8052-dd9684a8baf8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:29.988337 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c1cf7c39-1ddc-43cc-82fb-0a52bd0c4635 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:29.989489 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c1cf7c39-1ddc-43cc-82fb-0a52bd0c4635 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:30.000297 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1cf7c39-1ddc-43cc-82fb-0a52bd0c4635 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:30.007945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1cf7c39-1ddc-43cc-82fb-0a52bd0c4635 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:30.009239 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1cf7c39-1ddc-43cc-82fb-0a52bd0c4635 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:30.013040 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1cf7c39-1ddc-43cc-82fb-0a52bd0c4635 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:30.043010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-3756264f-55cf-4a1e-8052-dd9684a8baf8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:30.059416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3756264f-55cf-4a1e-8052-dd9684a8baf8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.226156 May 12 09:34:30.060689 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 62/138] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:29 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:30.189341 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-86d90474-027d-47bf-a3eb-1ce7db95a624 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:30.190131 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-86d90474-027d-47bf-a3eb-1ce7db95a624 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:30.203191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-86d90474-027d-47bf-a3eb-1ce7db95a624 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:30.204955 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-86d90474-027d-47bf-a3eb-1ce7db95a624 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:30.206998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-86d90474-027d-47bf-a3eb-1ce7db95a624 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:30.208234 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-86d90474-027d-47bf-a3eb-1ce7db95a624 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:30.235419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c1cf7c39-1ddc-43cc-82fb-0a52bd0c4635 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:30.250778 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c1cf7c39-1ddc-43cc-82fb-0a52bd0c4635 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.266045 May 12 09:34:30.251558 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 77/139] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:29 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:30.344892 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cf9b7e1f-d765-4a2a-9309-64c4e9099df3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:30.345826 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cf9b7e1f-d765-4a2a-9309-64c4e9099df3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:30.360045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cf9b7e1f-d765-4a2a-9309-64c4e9099df3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:30.368225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cf9b7e1f-d765-4a2a-9309-64c4e9099df3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:30.369147 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cf9b7e1f-d765-4a2a-9309-64c4e9099df3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:30.369603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cf9b7e1f-d765-4a2a-9309-64c4e9099df3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:30.404787 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-86d90474-027d-47bf-a3eb-1ce7db95a624 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:30.412124 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-86d90474-027d-47bf-a3eb-1ce7db95a624 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.227352 May 12 09:34:30.414444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 63/140] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:30 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:30.565516 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-cf9b7e1f-d765-4a2a-9309-64c4e9099df3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:30.573444 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cf9b7e1f-d765-4a2a-9309-64c4e9099df3 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.232706 May 12 09:34:30.575918 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 78/141] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:30 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:30.846153 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-909101199", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "networks": [{"uuid": "1c036158-1d81-400b-8003-63be31daecc9"}]}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:30.908065 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] validate_networks() for [('1c036158-1d81-400b-8003-63be31daecc9', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:34:31.077653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-85e7e4df-d157-466b-a57c-86c2d51e11dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:31.078373 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-85e7e4df-d157-466b-a57c-86c2d51e11dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:31.084770 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-85e7e4df-d157-466b-a57c-86c2d51e11dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.085265 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-85e7e4df-d157-466b-a57c-86c2d51e11dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.086053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-85e7e4df-d157-466b-a57c-86c2d51e11dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.086517 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-85e7e4df-d157-466b-a57c-86c2d51e11dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.348997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-85e7e4df-d157-466b-a57c-86c2d51e11dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:31.358587 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-85e7e4df-d157-466b-a57c-86c2d51e11dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.284725 May 12 09:34:31.360959 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 79/142] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:31 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:31.367912 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8e5ed41a-408e-4c84-8bf6-cf82574518ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:31.369644 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8e5ed41a-408e-4c84-8bf6-cf82574518ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:31.376424 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e5ed41a-408e-4c84-8bf6-cf82574518ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.376883 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e5ed41a-408e-4c84-8bf6-cf82574518ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.377659 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e5ed41a-408e-4c84-8bf6-cf82574518ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.378301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e5ed41a-408e-4c84-8bf6-cf82574518ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.395342 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:34:31.395769 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:34:31.396238 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:34:31.396642 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:34:31.397046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:34:31.408632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.409164 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.410220 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.410773 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.437520 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Getting quotas for project 59546c2ca0074bb5b77b7c5e64d9c068. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:34:31.441815 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Getting quotas for user 7dd6d3e1b6ea49d4a75e5f7e105ea0f0 and project 59546c2ca0074bb5b77b7c5e64d9c068. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:34:31.453790 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:34:31.456354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:34:31.513986 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-00441f26-4b64-48ea-a5a2-179fddaa115b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671272 May 12 09:34:31.516477 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 64/143] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:34:31.523271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-d7cc3517-9781-4128-a7e4-5d62f53584bb req-7b01177d-99e5-4571-9a60-44b49e1877a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed911f6-afdf-49e6-9897-e51a903b7680", "name": "network-vif-plugged", "status": "completed", "tag": "d8e31c88-6d60-467b-8eec-0d8851da1ced"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:31.534597 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8e5ed41a-408e-4c84-8bf6-cf82574518ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:31.542672 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8e5ed41a-408e-4c84-8bf6-cf82574518ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.180631 May 12 09:34:31.543300 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 80/144] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:31 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:31.545579 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-d7cc3517-9781-4128-a7e4-5d62f53584bb req-7b01177d-99e5-4571-9a60-44b49e1877a3 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.546047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-d7cc3517-9781-4128-a7e4-5d62f53584bb req-7b01177d-99e5-4571-9a60-44b49e1877a3 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.548413 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2fb3bc5c-2da1-4513-9050-5d66455da5ab tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:31.549016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2fb3bc5c-2da1-4513-9050-5d66455da5ab tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:31.555408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb3bc5c-2da1-4513-9050-5d66455da5ab tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.556260 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb3bc5c-2da1-4513-9050-5d66455da5ab tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.556589 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb3bc5c-2da1-4513-9050-5d66455da5ab tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.557023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb3bc5c-2da1-4513-9050-5d66455da5ab tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.578819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-d7cc3517-9781-4128-a7e4-5d62f53584bb req-7b01177d-99e5-4571-9a60-44b49e1877a3 service nova] Creating event network-vif-plugged:d8e31c88-6d60-467b-8eec-0d8851da1ced for instance 4ed911f6-afdf-49e6-9897-e51a903b7680 on hv-cinder-83769 May 12 09:34:31.579592 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-d7cc3517-9781-4128-a7e4-5d62f53584bb req-7b01177d-99e5-4571-9a60-44b49e1877a3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123509) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 12 09:34:31.581026 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6c5fa12b-1d4f-4674-a01e-1c864029d4ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.581679 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6c5fa12b-1d4f-4674-a01e-1c864029d4ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.582820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6c5fa12b-1d4f-4674-a01e-1c864029d4ee None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.583787 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6c5fa12b-1d4f-4674-a01e-1c864029d4ee None None] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.594074 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.compute.rpcapi [None req-6c5fa12b-1d4f-4674-a01e-1c864029d4ee None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 12 09:34:31.595718 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6c5fa12b-1d4f-4674-a01e-1c864029d4ee None None] Releasing lock "compute-rpcapi-router" {{(pid=123509) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 12 09:34:31.619069 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6c5fa12b-1d4f-4674-a01e-1c864029d4ee None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100964 May 12 09:34:31.620254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 65/145] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:31.631029 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6a81dcec-3ad3-4d46-b457-6de2b8fe2754 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:31.631769 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6a81dcec-3ad3-4d46-b457-6de2b8fe2754 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:31.706384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6a81dcec-3ad3-4d46-b457-6de2b8fe2754 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:31.723607 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6a81dcec-3ad3-4d46-b457-6de2b8fe2754 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1218 microversion: 2.1 time: 0.101700 May 12 09:34:31.726824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 66/146] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:31 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:31.739131 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2fb3bc5c-2da1-4513-9050-5d66455da5ab tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:31.741847 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-57c35043-2acd-4d49-b1cc-68e3a8ec8211 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:31.742546 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-57c35043-2acd-4d49-b1cc-68e3a8ec8211 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:31.749110 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2fb3bc5c-2da1-4513-9050-5d66455da5ab tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.204708 May 12 09:34:31.751303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-57c35043-2acd-4d49-b1cc-68e3a8ec8211 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.752218 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-57c35043-2acd-4d49-b1cc-68e3a8ec8211 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.753110 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-57c35043-2acd-4d49-b1cc-68e3a8ec8211 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:31.753625 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-57c35043-2acd-4d49-b1cc-68e3a8ec8211 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:31.759406 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 81/147] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:31 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:31.927813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-57c35043-2acd-4d49-b1cc-68e3a8ec8211 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:31.935980 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-57c35043-2acd-4d49-b1cc-68e3a8ec8211 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.207382 May 12 09:34:31.937108 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 67/148] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:31 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:32.376509 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-078adc3e-1070-4486-9c28-2017c746492b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:32.377112 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-078adc3e-1070-4486-9c28-2017c746492b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:32.383438 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-078adc3e-1070-4486-9c28-2017c746492b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.384417 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-078adc3e-1070-4486-9c28-2017c746492b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:32.385317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-078adc3e-1070-4486-9c28-2017c746492b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.385818 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-078adc3e-1070-4486-9c28-2017c746492b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:32.528984 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-078adc3e-1070-4486-9c28-2017c746492b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:32.540555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-078adc3e-1070-4486-9c28-2017c746492b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.167289 May 12 09:34:32.541837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 82/149] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:32 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:32.562286 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ffc4e702-de48-4f0a-9a7a-829b1552f892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:32.562939 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ffc4e702-de48-4f0a-9a7a-829b1552f892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:32.569813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ffc4e702-de48-4f0a-9a7a-829b1552f892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.570287 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ffc4e702-de48-4f0a-9a7a-829b1552f892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:32.571050 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ffc4e702-de48-4f0a-9a7a-829b1552f892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.571477 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ffc4e702-de48-4f0a-9a7a-829b1552f892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:32.720736 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ffc4e702-de48-4f0a-9a7a-829b1552f892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:32.728114 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ffc4e702-de48-4f0a-9a7a-829b1552f892 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.171987 May 12 09:34:32.728889 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 68/150] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:32 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:32.743490 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2b1e93d6-b4cd-453e-bf9b-e7195ad29bc6 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:32.744633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2b1e93d6-b4cd-453e-bf9b-e7195ad29bc6 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:32.751132 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2b1e93d6-b4cd-453e-bf9b-e7195ad29bc6 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.751584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2b1e93d6-b4cd-453e-bf9b-e7195ad29bc6 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:32.752347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2b1e93d6-b4cd-453e-bf9b-e7195ad29bc6 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.752813 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2b1e93d6-b4cd-453e-bf9b-e7195ad29bc6 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:32.766292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e237a228-7c4b-4ebd-abdc-af33847df8fc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:32.766930 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e237a228-7c4b-4ebd-abdc-af33847df8fc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:32.774354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e237a228-7c4b-4ebd-abdc-af33847df8fc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.774888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e237a228-7c4b-4ebd-abdc-af33847df8fc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:32.775786 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e237a228-7c4b-4ebd-abdc-af33847df8fc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.776423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e237a228-7c4b-4ebd-abdc-af33847df8fc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:32.843071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2b1e93d6-b4cd-453e-bf9b-e7195ad29bc6 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:32.850143 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2b1e93d6-b4cd-453e-bf9b-e7195ad29bc6 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1222 microversion: 2.1 time: 0.111192 May 12 09:34:32.850748 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 83/151] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:32 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:32.954723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e237a228-7c4b-4ebd-abdc-af33847df8fc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:32.959392 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a8ae9dd2-67c9-4e35-9f82-41e4ebebd471 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:32.960567 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a8ae9dd2-67c9-4e35-9f82-41e4ebebd471 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:32.962787 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e237a228-7c4b-4ebd-abdc-af33847df8fc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.200618 May 12 09:34:32.963760 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 69/152] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:32 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:32.973761 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a8ae9dd2-67c9-4e35-9f82-41e4ebebd471 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.974263 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a8ae9dd2-67c9-4e35-9f82-41e4ebebd471 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:32.975038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a8ae9dd2-67c9-4e35-9f82-41e4ebebd471 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:32.975696 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a8ae9dd2-67c9-4e35-9f82-41e4ebebd471 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:33.108578 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a8ae9dd2-67c9-4e35-9f82-41e4ebebd471 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:33.121491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a8ae9dd2-67c9-4e35-9f82-41e4ebebd471 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.171946 May 12 09:34:33.122640 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 84/153] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:32 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:33.558428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-42eae8b1-7a7d-46db-ac05-aa5af97db47b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:33.561141 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-42eae8b1-7a7d-46db-ac05-aa5af97db47b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:33.571417 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-42eae8b1-7a7d-46db-ac05-aa5af97db47b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:33.572161 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-42eae8b1-7a7d-46db-ac05-aa5af97db47b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:33.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-42eae8b1-7a7d-46db-ac05-aa5af97db47b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:33.574030 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-42eae8b1-7a7d-46db-ac05-aa5af97db47b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:33.745065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c35ef829-67bb-4c8a-acf0-53abc10f9b69 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:33.745663 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c35ef829-67bb-4c8a-acf0-53abc10f9b69 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:33.761908 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c35ef829-67bb-4c8a-acf0-53abc10f9b69 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:33.762364 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c35ef829-67bb-4c8a-acf0-53abc10f9b69 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:33.763134 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c35ef829-67bb-4c8a-acf0-53abc10f9b69 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:33.763568 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c35ef829-67bb-4c8a-acf0-53abc10f9b69 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:34.487302 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-42eae8b1-7a7d-46db-ac05-aa5af97db47b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:34.494525 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-42eae8b1-7a7d-46db-ac05-aa5af97db47b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.940633 May 12 09:34:34.495659 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 70/154] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:33 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:34.500288 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-12c0e8d0-ee61-4a00-bdae-0e1e5148025f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:34.501039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-12c0e8d0-ee61-4a00-bdae-0e1e5148025f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:34.509563 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-12c0e8d0-ee61-4a00-bdae-0e1e5148025f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:34.510015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-12c0e8d0-ee61-4a00-bdae-0e1e5148025f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:34.510991 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-12c0e8d0-ee61-4a00-bdae-0e1e5148025f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:34.511421 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-12c0e8d0-ee61-4a00-bdae-0e1e5148025f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:34.535911 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c35ef829-67bb-4c8a-acf0-53abc10f9b69 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:34.543802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c35ef829-67bb-4c8a-acf0-53abc10f9b69 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.803094 May 12 09:34:34.544888 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 85/155] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:33 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:34.550384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d50910b9-3f37-4e40-a6fd-6a6e0560d0be tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:34.551193 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d50910b9-3f37-4e40-a6fd-6a6e0560d0be tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:34.559260 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d50910b9-3f37-4e40-a6fd-6a6e0560d0be tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:34.560001 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d50910b9-3f37-4e40-a6fd-6a6e0560d0be tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:34.560935 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d50910b9-3f37-4e40-a6fd-6a6e0560d0be tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:34.562115 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d50910b9-3f37-4e40-a6fd-6a6e0560d0be tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:34.610405 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-12c0e8d0-ee61-4a00-bdae-0e1e5148025f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:34.618599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-12c0e8d0-ee61-4a00-bdae-0e1e5148025f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1276 microversion: 2.1 time: 0.121727 May 12 09:34:34.619383 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 71/156] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:34 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:34.624580 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f1f7eac9-28d6-4c1b-8120-939939cfc570 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:34.625236 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f1f7eac9-28d6-4c1b-8120-939939cfc570 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:34.631681 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f1f7eac9-28d6-4c1b-8120-939939cfc570 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:34.632921 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f1f7eac9-28d6-4c1b-8120-939939cfc570 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:34.633878 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f1f7eac9-28d6-4c1b-8120-939939cfc570 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:34.634747 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f1f7eac9-28d6-4c1b-8120-939939cfc570 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:34.814047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d50910b9-3f37-4e40-a6fd-6a6e0560d0be tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:34.825734 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d50910b9-3f37-4e40-a6fd-6a6e0560d0be tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.278858 May 12 09:34:34.826631 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 86/157] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:34 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:34.859772 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f1f7eac9-28d6-4c1b-8120-939939cfc570 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:34.880117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f1f7eac9-28d6-4c1b-8120-939939cfc570 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.259022 May 12 09:34:34.882282 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 72/158] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:34 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:35.513214 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b29ec3bc-1403-4578-9ab1-f2a1429ef7de tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:35.514426 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b29ec3bc-1403-4578-9ab1-f2a1429ef7de tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:35.524395 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b29ec3bc-1403-4578-9ab1-f2a1429ef7de tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:35.525207 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b29ec3bc-1403-4578-9ab1-f2a1429ef7de tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:35.526480 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b29ec3bc-1403-4578-9ab1-f2a1429ef7de tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:35.527175 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b29ec3bc-1403-4578-9ab1-f2a1429ef7de tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:35.560739 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0e2fba9d-702a-4291-8926-b6ef2e4e0fdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:35.561353 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0e2fba9d-702a-4291-8926-b6ef2e4e0fdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:35.569381 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e2fba9d-702a-4291-8926-b6ef2e4e0fdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:35.569841 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e2fba9d-702a-4291-8926-b6ef2e4e0fdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:35.570655 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e2fba9d-702a-4291-8926-b6ef2e4e0fdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:35.576593 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e2fba9d-702a-4291-8926-b6ef2e4e0fdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:35.832756 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b29ec3bc-1403-4578-9ab1-f2a1429ef7de tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:35.851873 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b29ec3bc-1403-4578-9ab1-f2a1429ef7de tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.343334 May 12 09:34:35.854434 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 87/159] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:35 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:35.870121 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-712bdb98-462c-4d0e-8655-ff98fa9fe22a req-ec789b7c-03f0-404e-ad7a-d1488e585401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dadb998-7d24-461d-bf2f-cec5ab30fb48", "name": "network-vif-plugged", "status": "completed", "tag": "c4a1fbd1-1e2f-4367-8cd0-c2f3b5182c2b"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:35.891396 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-712bdb98-462c-4d0e-8655-ff98fa9fe22a req-ec789b7c-03f0-404e-ad7a-d1488e585401 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:35.891841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-712bdb98-462c-4d0e-8655-ff98fa9fe22a req-ec789b7c-03f0-404e-ad7a-d1488e585401 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:35.895750 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0e2fba9d-702a-4291-8926-b6ef2e4e0fdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:35.905413 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0e2fba9d-702a-4291-8926-b6ef2e4e0fdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.348440 May 12 09:34:35.906883 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 73/160] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:35 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:35.920298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-37236a30-2e65-4c87-8f41-b96b8707f734 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:35.920494 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-712bdb98-462c-4d0e-8655-ff98fa9fe22a req-ec789b7c-03f0-404e-ad7a-d1488e585401 service nova] Creating event network-vif-plugged:c4a1fbd1-1e2f-4367-8cd0-c2f3b5182c2b for instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 on hv-cinder-83769 May 12 09:34:35.920961 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-37236a30-2e65-4c87-8f41-b96b8707f734 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:35.925655 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-712bdb98-462c-4d0e-8655-ff98fa9fe22a req-ec789b7c-03f0-404e-ad7a-d1488e585401 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070014 May 12 09:34:35.926782 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 88/161] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:35.934155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-37236a30-2e65-4c87-8f41-b96b8707f734 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:35.934155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-37236a30-2e65-4c87-8f41-b96b8707f734 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:35.934155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-37236a30-2e65-4c87-8f41-b96b8707f734 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:35.934155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-37236a30-2e65-4c87-8f41-b96b8707f734 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:35.935799 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-80579f61-168d-497a-8900-f537dfca5932 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:35.935799 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-80579f61-168d-497a-8900-f537dfca5932 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:35.942550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-80579f61-168d-497a-8900-f537dfca5932 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:35.943134 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-80579f61-168d-497a-8900-f537dfca5932 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:35.944585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-80579f61-168d-497a-8900-f537dfca5932 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:35.945240 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-80579f61-168d-497a-8900-f537dfca5932 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:36.012980 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-37236a30-2e65-4c87-8f41-b96b8707f734 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:36.020545 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-37236a30-2e65-4c87-8f41-b96b8707f734 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1276 microversion: 2.1 time: 0.112458 May 12 09:34:36.030289 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 74/162] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:35 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:36.030289 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ce323b95-8833-486e-ada8-c8c43bc4ccca tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:36.030602 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ce323b95-8833-486e-ada8-c8c43bc4ccca tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:36.036671 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ce323b95-8833-486e-ada8-c8c43bc4ccca tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:36.037329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ce323b95-8833-486e-ada8-c8c43bc4ccca tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:36.038165 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ce323b95-8833-486e-ada8-c8c43bc4ccca tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:36.038760 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ce323b95-8833-486e-ada8-c8c43bc4ccca tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:36.280064 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ce323b95-8833-486e-ada8-c8c43bc4ccca tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:36.289637 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ce323b95-8833-486e-ada8-c8c43bc4ccca tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1314 microversion: 2.1 time: 0.267477 May 12 09:34:36.293274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 75/163] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:36 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:36.385536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-80579f61-168d-497a-8900-f537dfca5932 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:36.408766 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-80579f61-168d-497a-8900-f537dfca5932 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.480425 May 12 09:34:36.409671 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 89/164] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:35 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:36.872824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-36e0ca7f-b201-48b9-b8c9-196eecbd2f00 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:36.873449 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-36e0ca7f-b201-48b9-b8c9-196eecbd2f00 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:36.884572 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-36e0ca7f-b201-48b9-b8c9-196eecbd2f00 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:36.884899 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-36e0ca7f-b201-48b9-b8c9-196eecbd2f00 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:36.885683 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-36e0ca7f-b201-48b9-b8c9-196eecbd2f00 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:36.886513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-36e0ca7f-b201-48b9-b8c9-196eecbd2f00 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:36.923165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5d11f395-2efa-4aed-a5c9-ed3b3d79749f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:36.923790 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5d11f395-2efa-4aed-a5c9-ed3b3d79749f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:36.930277 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5d11f395-2efa-4aed-a5c9-ed3b3d79749f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:36.930727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5d11f395-2efa-4aed-a5c9-ed3b3d79749f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:36.931942 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5d11f395-2efa-4aed-a5c9-ed3b3d79749f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:36.932304 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5d11f395-2efa-4aed-a5c9-ed3b3d79749f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:37.123710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-36e0ca7f-b201-48b9-b8c9-196eecbd2f00 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:37.132950 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-36e0ca7f-b201-48b9-b8c9-196eecbd2f00 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.265380 May 12 09:34:37.134880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 76/165] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:36 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:37.136638 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5d11f395-2efa-4aed-a5c9-ed3b3d79749f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:37.141189 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a1e47dc9-c3a2-44f0-865a-fd94be898623 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:37.142108 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a1e47dc9-c3a2-44f0-865a-fd94be898623 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:37.148540 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a1e47dc9-c3a2-44f0-865a-fd94be898623 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:37.148692 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5d11f395-2efa-4aed-a5c9-ed3b3d79749f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.229558 May 12 09:34:37.149303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a1e47dc9-c3a2-44f0-865a-fd94be898623 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:37.149424 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 90/166] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:36 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:37.150426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a1e47dc9-c3a2-44f0-865a-fd94be898623 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:37.151014 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a1e47dc9-c3a2-44f0-865a-fd94be898623 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:37.304772 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a1e47dc9-c3a2-44f0-865a-fd94be898623 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:37.311092 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-fe7f31b3-e6e7-4224-bdfe-d84315cff219 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:37.311694 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-fe7f31b3-e6e7-4224-bdfe-d84315cff219 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:37.315033 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a1e47dc9-c3a2-44f0-865a-fd94be898623 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.178904 May 12 09:34:37.321320 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 77/167] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:37 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:37.332992 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fe7f31b3-e6e7-4224-bdfe-d84315cff219 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:37.334063 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fe7f31b3-e6e7-4224-bdfe-d84315cff219 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:37.334957 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fe7f31b3-e6e7-4224-bdfe-d84315cff219 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:37.335511 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fe7f31b3-e6e7-4224-bdfe-d84315cff219 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:37.427197 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-23de9d6e-ef34-4473-b261-bdd21382ca46 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:37.429073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-23de9d6e-ef34-4473-b261-bdd21382ca46 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:37.437461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-23de9d6e-ef34-4473-b261-bdd21382ca46 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:37.437832 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-23de9d6e-ef34-4473-b261-bdd21382ca46 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:37.438668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-23de9d6e-ef34-4473-b261-bdd21382ca46 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:37.439096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-23de9d6e-ef34-4473-b261-bdd21382ca46 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:37.584269 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-fe7f31b3-e6e7-4224-bdfe-d84315cff219 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:37.598979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-fe7f31b3-e6e7-4224-bdfe-d84315cff219 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1501 microversion: 2.1 time: 0.291517 May 12 09:34:37.601089 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 91/168] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:37 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:37.675814 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-23de9d6e-ef34-4473-b261-bdd21382ca46 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:37.685047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-23de9d6e-ef34-4473-b261-bdd21382ca46 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.262236 May 12 09:34:37.685627 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 78/169] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:37 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:37.949777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-57931857-afdb-4680-9597-2dcd86cfa169 req-a0f923af-11c5-4743-aef9-fe8c050c833b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc90e8c3-13f2-4b3e-91e8-396847cf6572", "name": "network-vif-plugged", "status": "completed", "tag": "332c08c8-a0fb-4e00-b6b4-9b038555668c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:37.972841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-57931857-afdb-4680-9597-2dcd86cfa169 req-a0f923af-11c5-4743-aef9-fe8c050c833b service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:37.975148 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-57931857-afdb-4680-9597-2dcd86cfa169 req-a0f923af-11c5-4743-aef9-fe8c050c833b service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.012180 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-57931857-afdb-4680-9597-2dcd86cfa169 req-a0f923af-11c5-4743-aef9-fe8c050c833b service nova] Creating event network-vif-plugged:332c08c8-a0fb-4e00-b6b4-9b038555668c for instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 on hv-cinder-83769 May 12 09:34:38.022861 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-57931857-afdb-4680-9597-2dcd86cfa169 req-a0f923af-11c5-4743-aef9-fe8c050c833b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076649 May 12 09:34:38.029005 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 92/170] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:38.151112 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ac7e8708-3e2f-44b4-b4e1-2c9b50bd2c99 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:38.151715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ac7e8708-3e2f-44b4-b4e1-2c9b50bd2c99 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:38.157473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac7e8708-3e2f-44b4-b4e1-2c9b50bd2c99 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:38.158132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac7e8708-3e2f-44b4-b4e1-2c9b50bd2c99 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.159562 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac7e8708-3e2f-44b4-b4e1-2c9b50bd2c99 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:38.160005 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac7e8708-3e2f-44b4-b4e1-2c9b50bd2c99 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.167350 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-27510f07-bfa9-427b-bf8b-e48b241cced5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:38.168092 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-27510f07-bfa9-427b-bf8b-e48b241cced5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:38.175832 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27510f07-bfa9-427b-bf8b-e48b241cced5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:38.176334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27510f07-bfa9-427b-bf8b-e48b241cced5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.177270 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27510f07-bfa9-427b-bf8b-e48b241cced5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:38.178028 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27510f07-bfa9-427b-bf8b-e48b241cced5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.414540 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ac7e8708-3e2f-44b4-b4e1-2c9b50bd2c99 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:38.416982 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-27510f07-bfa9-427b-bf8b-e48b241cced5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:38.425164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-27510f07-bfa9-427b-bf8b-e48b241cced5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.263254 May 12 09:34:38.426362 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 93/171] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:38 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:38.431136 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2a1686bf-b290-4cf4-9b7d-6e7bf1cf66cf tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:38.432021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2a1686bf-b290-4cf4-9b7d-6e7bf1cf66cf tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:38.435556 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ac7e8708-3e2f-44b4-b4e1-2c9b50bd2c99 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.288363 May 12 09:34:38.438869 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2a1686bf-b290-4cf4-9b7d-6e7bf1cf66cf tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:38.439378 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2a1686bf-b290-4cf4-9b7d-6e7bf1cf66cf tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.440337 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2a1686bf-b290-4cf4-9b7d-6e7bf1cf66cf tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:38.440865 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2a1686bf-b290-4cf4-9b7d-6e7bf1cf66cf tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.446064 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 79/172] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:38 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:38.636952 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2a1686bf-b290-4cf4-9b7d-6e7bf1cf66cf tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:38.646400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2a1686bf-b290-4cf4-9b7d-6e7bf1cf66cf tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.218650 May 12 09:34:38.648479 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 94/173] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:38 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:38.706392 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4cf9300d-c07f-4ed3-81eb-02e79c46ec40 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:38.707360 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4cf9300d-c07f-4ed3-81eb-02e79c46ec40 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:38.722225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cf9300d-c07f-4ed3-81eb-02e79c46ec40 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:38.730526 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cf9300d-c07f-4ed3-81eb-02e79c46ec40 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.733035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cf9300d-c07f-4ed3-81eb-02e79c46ec40 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:38.733482 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cf9300d-c07f-4ed3-81eb-02e79c46ec40 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.747051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-2f28cb81-57dc-4b11-bdec-38a53f6e6d56 req-50f044f7-f90d-4212-846b-9186e2e4b2cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d286f5-766e-42c0-a80c-4526ac1b3829", "tag": "50f1df2b-d761-4daf-aea9-a81a341d7a3c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:38.766196 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-2f28cb81-57dc-4b11-bdec-38a53f6e6d56 req-50f044f7-f90d-4212-846b-9186e2e4b2cd service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:38.766650 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-2f28cb81-57dc-4b11-bdec-38a53f6e6d56 req-50f044f7-f90d-4212-846b-9186e2e4b2cd service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:38.785392 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-2f28cb81-57dc-4b11-bdec-38a53f6e6d56 req-50f044f7-f90d-4212-846b-9186e2e4b2cd service nova] Creating event network-changed:50f1df2b-d761-4daf-aea9-a81a341d7a3c for instance 56d286f5-766e-42c0-a80c-4526ac1b3829 on hv-cinder-83769 May 12 09:34:38.799718 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-2f28cb81-57dc-4b11-bdec-38a53f6e6d56 req-50f044f7-f90d-4212-846b-9186e2e4b2cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057276 May 12 09:34:38.802247 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 95/174] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:34:38.951035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4cf9300d-c07f-4ed3-81eb-02e79c46ec40 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:38.959194 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4cf9300d-c07f-4ed3-81eb-02e79c46ec40 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.258961 May 12 09:34:38.960522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 80/175] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:38 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:39.085582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6dae528d-ec25-4701-b1b1-264129b0e7d2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ad92af-8907-48c3-a3bc-e2a0bbfdd875"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:39.086764 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6dae528d-ec25-4701-b1b1-264129b0e7d2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:39.092803 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6dae528d-ec25-4701-b1b1-264129b0e7d2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.093250 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6dae528d-ec25-4701-b1b1-264129b0e7d2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:39.094071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6dae528d-ec25-4701-b1b1-264129b0e7d2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.094511 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6dae528d-ec25-4701-b1b1-264129b0e7d2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:39.442997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-493418da-3c3b-42a3-adae-152b63f987d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:39.443729 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-493418da-3c3b-42a3-adae-152b63f987d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:39.470807 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-493418da-3c3b-42a3-adae-152b63f987d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.471821 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-493418da-3c3b-42a3-adae-152b63f987d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:39.473503 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-493418da-3c3b-42a3-adae-152b63f987d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.474445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-493418da-3c3b-42a3-adae-152b63f987d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:39.720692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-493418da-3c3b-42a3-adae-152b63f987d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:39.728627 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-493418da-3c3b-42a3-adae-152b63f987d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.290169 May 12 09:34:39.729197 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 81/176] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:39 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:39.744376 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e2a6bdb9-92d1-498d-9440-2b6223e665c7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:39.744987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e2a6bdb9-92d1-498d-9440-2b6223e665c7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:39.755160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2a6bdb9-92d1-498d-9440-2b6223e665c7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.756058 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2a6bdb9-92d1-498d-9440-2b6223e665c7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:39.757585 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2a6bdb9-92d1-498d-9440-2b6223e665c7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.758247 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2a6bdb9-92d1-498d-9440-2b6223e665c7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:39.810702 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6dae528d-ec25-4701-b1b1-264129b0e7d2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "POST /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729133 May 12 09:34:39.811442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 96/177] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:34:39 2022] POST /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:39.816677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-603be797-1243-44d3-8542-e9881e5a3cbe tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:39.817650 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-603be797-1243-44d3-8542-e9881e5a3cbe tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:39.824548 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-603be797-1243-44d3-8542-e9881e5a3cbe tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.825262 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-603be797-1243-44d3-8542-e9881e5a3cbe tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:39.826270 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-603be797-1243-44d3-8542-e9881e5a3cbe tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.827356 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-603be797-1243-44d3-8542-e9881e5a3cbe tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:39.944598 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e2a6bdb9-92d1-498d-9440-2b6223e665c7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:39.953088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e2a6bdb9-92d1-498d-9440-2b6223e665c7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.220355 May 12 09:34:39.953672 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 82/178] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:39 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:39.977496 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b8df20d2-668b-48e4-b20a-6629709d2ad4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:39.978073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b8df20d2-668b-48e4-b20a-6629709d2ad4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:39.995184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b8df20d2-668b-48e4-b20a-6629709d2ad4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.995468 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b8df20d2-668b-48e4-b20a-6629709d2ad4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:39.996249 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b8df20d2-668b-48e4-b20a-6629709d2ad4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:39.996682 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b8df20d2-668b-48e4-b20a-6629709d2ad4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:40.017030 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-603be797-1243-44d3-8542-e9881e5a3cbe tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:40.026810 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-603be797-1243-44d3-8542-e9881e5a3cbe tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.214055 May 12 09:34:40.028058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 97/179] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:39 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:40.166755 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b8df20d2-668b-48e4-b20a-6629709d2ad4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:40.174108 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b8df20d2-668b-48e4-b20a-6629709d2ad4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.201220 May 12 09:34:40.174775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 83/180] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:39 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:40.744910 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1895a40e-922d-4978-8ed6-86735033f2e4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:40.746147 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1895a40e-922d-4978-8ed6-86735033f2e4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:40.752551 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1895a40e-922d-4978-8ed6-86735033f2e4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:40.753005 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1895a40e-922d-4978-8ed6-86735033f2e4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:40.754881 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1895a40e-922d-4978-8ed6-86735033f2e4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:40.755337 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1895a40e-922d-4978-8ed6-86735033f2e4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:40.893727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1895a40e-922d-4978-8ed6-86735033f2e4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:40.901926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1895a40e-922d-4978-8ed6-86735033f2e4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.161049 May 12 09:34:40.911540 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 98/181] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:40 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:40.969941 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1dafbf2a-4ef4-44cd-b191-6ffa0c5b748c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:40.971516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1dafbf2a-4ef4-44cd-b191-6ffa0c5b748c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:40.981526 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1dafbf2a-4ef4-44cd-b191-6ffa0c5b748c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:40.982107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1dafbf2a-4ef4-44cd-b191-6ffa0c5b748c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:40.982959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1dafbf2a-4ef4-44cd-b191-6ffa0c5b748c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:40.983469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1dafbf2a-4ef4-44cd-b191-6ffa0c5b748c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:41.043945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-38a9b9c9-c59c-447a-86d1-dd5ea6c5c9bd tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:41.044637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-38a9b9c9-c59c-447a-86d1-dd5ea6c5c9bd tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:41.052350 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-38a9b9c9-c59c-447a-86d1-dd5ea6c5c9bd tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:41.052827 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-38a9b9c9-c59c-447a-86d1-dd5ea6c5c9bd tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:41.054070 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-38a9b9c9-c59c-447a-86d1-dd5ea6c5c9bd tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:41.054476 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-38a9b9c9-c59c-447a-86d1-dd5ea6c5c9bd tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:41.210945 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1dafbf2a-4ef4-44cd-b191-6ffa0c5b748c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:41.230617 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1dafbf2a-4ef4-44cd-b191-6ffa0c5b748c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.264376 May 12 09:34:41.232602 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 84/182] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:40 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:41.246666 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ef125a9b-9c0f-47ce-917d-71408e03b528 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:41.248610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-38a9b9c9-c59c-447a-86d1-dd5ea6c5c9bd tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:41.248745 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ef125a9b-9c0f-47ce-917d-71408e03b528 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:41.256278 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-38a9b9c9-c59c-447a-86d1-dd5ea6c5c9bd tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.216063 May 12 09:34:41.257604 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 99/183] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:41 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:41.258372 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ef125a9b-9c0f-47ce-917d-71408e03b528 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:41.261983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ef125a9b-9c0f-47ce-917d-71408e03b528 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:41.263434 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ef125a9b-9c0f-47ce-917d-71408e03b528 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:41.264045 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ef125a9b-9c0f-47ce-917d-71408e03b528 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:41.406003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ef125a9b-9c0f-47ce-917d-71408e03b528 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:41.414057 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ef125a9b-9c0f-47ce-917d-71408e03b528 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.180274 May 12 09:34:41.415188 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 85/184] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:41 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:41.921319 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-acaa7ef5-07ad-4c5a-97a6-cdfc538ca6fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:41.921955 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-acaa7ef5-07ad-4c5a-97a6-cdfc538ca6fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:41.929411 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-acaa7ef5-07ad-4c5a-97a6-cdfc538ca6fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:41.929871 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-acaa7ef5-07ad-4c5a-97a6-cdfc538ca6fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:41.930672 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-acaa7ef5-07ad-4c5a-97a6-cdfc538ca6fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:41.931234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-acaa7ef5-07ad-4c5a-97a6-cdfc538ca6fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:42.088663 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-acaa7ef5-07ad-4c5a-97a6-cdfc538ca6fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:42.095959 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-acaa7ef5-07ad-4c5a-97a6-cdfc538ca6fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.179517 May 12 09:34:42.096518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 100/185] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:41 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:42.247602 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-29bac863-fb41-4051-a4d6-49fdafa2013d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:42.248348 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-29bac863-fb41-4051-a4d6-49fdafa2013d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:42.254355 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-29bac863-fb41-4051-a4d6-49fdafa2013d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:42.254943 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-29bac863-fb41-4051-a4d6-49fdafa2013d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:42.255823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-29bac863-fb41-4051-a4d6-49fdafa2013d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:42.256380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-29bac863-fb41-4051-a4d6-49fdafa2013d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:42.274750 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c916abe7-c281-48f0-b7de-53e326227911 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:42.275597 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c916abe7-c281-48f0-b7de-53e326227911 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:42.282234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c916abe7-c281-48f0-b7de-53e326227911 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:42.282681 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c916abe7-c281-48f0-b7de-53e326227911 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:42.283611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c916abe7-c281-48f0-b7de-53e326227911 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:42.284199 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c916abe7-c281-48f0-b7de-53e326227911 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:42.683617 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-29bac863-fb41-4051-a4d6-49fdafa2013d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:42.692584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-29bac863-fb41-4051-a4d6-49fdafa2013d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.448645 May 12 09:34:42.693328 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 86/186] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:42 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:42.694225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c916abe7-c281-48f0-b7de-53e326227911 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:42.698474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6872c3c3-8e7a-4f7f-8849-c014f56e8b24 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:42.699154 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6872c3c3-8e7a-4f7f-8849-c014f56e8b24 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:42.702245 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c916abe7-c281-48f0-b7de-53e326227911 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.431937 May 12 09:34:42.702508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 101/187] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:42 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:42.705987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6872c3c3-8e7a-4f7f-8849-c014f56e8b24 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:42.706443 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6872c3c3-8e7a-4f7f-8849-c014f56e8b24 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:42.707214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6872c3c3-8e7a-4f7f-8849-c014f56e8b24 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:42.707648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6872c3c3-8e7a-4f7f-8849-c014f56e8b24 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:42.835663 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6872c3c3-8e7a-4f7f-8849-c014f56e8b24 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:42.843906 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6872c3c3-8e7a-4f7f-8849-c014f56e8b24 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.148910 May 12 09:34:42.845208 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 87/188] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:42 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:43.113179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b38f3fcc-f470-41c3-a76e-ab80fc7cbf55 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:43.113179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b38f3fcc-f470-41c3-a76e-ab80fc7cbf55 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:43.119709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b38f3fcc-f470-41c3-a76e-ab80fc7cbf55 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:43.120165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b38f3fcc-f470-41c3-a76e-ab80fc7cbf55 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:43.120941 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b38f3fcc-f470-41c3-a76e-ab80fc7cbf55 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:43.121379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b38f3fcc-f470-41c3-a76e-ab80fc7cbf55 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:43.339145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b38f3fcc-f470-41c3-a76e-ab80fc7cbf55 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:43.347713 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b38f3fcc-f470-41c3-a76e-ab80fc7cbf55 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.238812 May 12 09:34:43.348372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 102/189] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:43 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:43.709858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-32ea77ee-91be-423f-adfb-98585ad163dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:43.710723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-32ea77ee-91be-423f-adfb-98585ad163dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:43.718187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-32ea77ee-91be-423f-adfb-98585ad163dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:43.718719 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-32ea77ee-91be-423f-adfb-98585ad163dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:43.719564 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-32ea77ee-91be-423f-adfb-98585ad163dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:43.720001 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-32ea77ee-91be-423f-adfb-98585ad163dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:43.722348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7ba4b534-7aff-4609-9ec8-610608f681eb tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:43.723945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7ba4b534-7aff-4609-9ec8-610608f681eb tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:43.731598 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ba4b534-7aff-4609-9ec8-610608f681eb tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:43.732389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ba4b534-7aff-4609-9ec8-610608f681eb tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:43.733416 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ba4b534-7aff-4609-9ec8-610608f681eb tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:43.734155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ba4b534-7aff-4609-9ec8-610608f681eb tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:44.032908 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7ba4b534-7aff-4609-9ec8-610608f681eb tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:44.042542 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-32ea77ee-91be-423f-adfb-98585ad163dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:44.043898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7ba4b534-7aff-4609-9ec8-610608f681eb tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.327778 May 12 09:34:44.044480 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 103/190] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:43 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:44.053300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-32ea77ee-91be-423f-adfb-98585ad163dc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.347421 May 12 09:34:44.054191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 88/191] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:43 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:44.055715 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4e25e110-f53e-478f-badd-7dbb87cb3000 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:44.056614 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4e25e110-f53e-478f-badd-7dbb87cb3000 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:44.064203 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e25e110-f53e-478f-badd-7dbb87cb3000 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:44.064784 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e25e110-f53e-478f-badd-7dbb87cb3000 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:44.066371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e25e110-f53e-478f-badd-7dbb87cb3000 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:44.067076 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e25e110-f53e-478f-badd-7dbb87cb3000 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:44.348550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4e25e110-f53e-478f-badd-7dbb87cb3000 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:44.365051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-63c319e9-8e53-44be-a277-e09ae29b854d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:44.366931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-63c319e9-8e53-44be-a277-e09ae29b854d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:44.375329 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4e25e110-f53e-478f-badd-7dbb87cb3000 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.308921 May 12 09:34:44.376058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 104/192] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:44 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:44.380459 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63c319e9-8e53-44be-a277-e09ae29b854d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:44.383889 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63c319e9-8e53-44be-a277-e09ae29b854d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:44.385557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63c319e9-8e53-44be-a277-e09ae29b854d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:44.385557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63c319e9-8e53-44be-a277-e09ae29b854d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:44.632764 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-63c319e9-8e53-44be-a277-e09ae29b854d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:44.651332 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-63c319e9-8e53-44be-a277-e09ae29b854d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.290175 May 12 09:34:44.654662 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 89/193] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:44 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:45.060448 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8528ac8f-8602-4a2c-b557-fc3a30df53ad tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:45.061059 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8528ac8f-8602-4a2c-b557-fc3a30df53ad tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:45.071631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-599a86e5-467c-4d6c-b08c-9d43f42906f8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:45.072254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-599a86e5-467c-4d6c-b08c-9d43f42906f8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:45.080071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-599a86e5-467c-4d6c-b08c-9d43f42906f8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:45.087172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8528ac8f-8602-4a2c-b557-fc3a30df53ad tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:45.088293 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8528ac8f-8602-4a2c-b557-fc3a30df53ad tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:45.088909 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-599a86e5-467c-4d6c-b08c-9d43f42906f8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:45.089979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8528ac8f-8602-4a2c-b557-fc3a30df53ad tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:45.091168 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-599a86e5-467c-4d6c-b08c-9d43f42906f8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:45.091771 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8528ac8f-8602-4a2c-b557-fc3a30df53ad tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:45.092366 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-599a86e5-467c-4d6c-b08c-9d43f42906f8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:45.386262 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-599a86e5-467c-4d6c-b08c-9d43f42906f8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:45.390432 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8528ac8f-8602-4a2c-b557-fc3a30df53ad tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:45.398844 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8528ac8f-8602-4a2c-b557-fc3a30df53ad tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.342199 May 12 09:34:45.399671 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 105/194] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:45 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:45.404430 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-44feaf04-bb94-4287-916e-8cd4fef5fa7a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:45.405225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-44feaf04-bb94-4287-916e-8cd4fef5fa7a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:45.409822 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-599a86e5-467c-4d6c-b08c-9d43f42906f8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.343259 May 12 09:34:45.411460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-44feaf04-bb94-4287-916e-8cd4fef5fa7a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:45.412072 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-44feaf04-bb94-4287-916e-8cd4fef5fa7a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:45.413588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-44feaf04-bb94-4287-916e-8cd4fef5fa7a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:45.414211 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-44feaf04-bb94-4287-916e-8cd4fef5fa7a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:45.420140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 90/195] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:45 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:45.638174 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-44feaf04-bb94-4287-916e-8cd4fef5fa7a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:45.646862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-44feaf04-bb94-4287-916e-8cd4fef5fa7a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.245825 May 12 09:34:45.657744 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 106/196] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:45 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:45.676519 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-613e25a2-c72e-4c31-9b7b-fd8ad3f1fdf6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:45.677140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-613e25a2-c72e-4c31-9b7b-fd8ad3f1fdf6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:45.689119 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-613e25a2-c72e-4c31-9b7b-fd8ad3f1fdf6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:45.689428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-613e25a2-c72e-4c31-9b7b-fd8ad3f1fdf6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:45.704598 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-613e25a2-c72e-4c31-9b7b-fd8ad3f1fdf6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:45.710524 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-613e25a2-c72e-4c31-9b7b-fd8ad3f1fdf6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:45.881604 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-613e25a2-c72e-4c31-9b7b-fd8ad3f1fdf6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:45.889279 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-613e25a2-c72e-4c31-9b7b-fd8ad3f1fdf6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.222017 May 12 09:34:45.889846 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 91/197] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:45 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:46.416030 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9655830a-7fac-46db-9bcc-6e23cc9882e8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:46.416795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9655830a-7fac-46db-9bcc-6e23cc9882e8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:46.428863 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0cab7d72-6b53-451f-9555-513bd0ba46ca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:46.429569 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0cab7d72-6b53-451f-9555-513bd0ba46ca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:46.432866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9655830a-7fac-46db-9bcc-6e23cc9882e8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:46.436214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0cab7d72-6b53-451f-9555-513bd0ba46ca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:46.436671 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0cab7d72-6b53-451f-9555-513bd0ba46ca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:46.437443 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0cab7d72-6b53-451f-9555-513bd0ba46ca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:46.438239 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9655830a-7fac-46db-9bcc-6e23cc9882e8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:46.439034 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9655830a-7fac-46db-9bcc-6e23cc9882e8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:46.439474 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9655830a-7fac-46db-9bcc-6e23cc9882e8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:46.444867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0cab7d72-6b53-451f-9555-513bd0ba46ca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:46.681815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9655830a-7fac-46db-9bcc-6e23cc9882e8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:46.689492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9655830a-7fac-46db-9bcc-6e23cc9882e8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.277187 May 12 09:34:46.694716 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 107/198] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:46 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:46.708510 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0c0805b6-1efb-4d9a-a8dd-b7680b6e654b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:46.710236 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0c0805b6-1efb-4d9a-a8dd-b7680b6e654b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:46.711166 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0cab7d72-6b53-451f-9555-513bd0ba46ca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:46.721604 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0cab7d72-6b53-451f-9555-513bd0ba46ca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.296917 May 12 09:34:46.722231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 92/199] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:46 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:46.737595 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c0805b6-1efb-4d9a-a8dd-b7680b6e654b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:46.738173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c0805b6-1efb-4d9a-a8dd-b7680b6e654b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:46.739056 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c0805b6-1efb-4d9a-a8dd-b7680b6e654b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:46.742349 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c0805b6-1efb-4d9a-a8dd-b7680b6e654b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:46.907474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-96926b6a-cf0a-4aa2-93a1-68fdfa808959 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:46.908392 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-96926b6a-cf0a-4aa2-93a1-68fdfa808959 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:46.917578 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96926b6a-cf0a-4aa2-93a1-68fdfa808959 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:46.918326 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96926b6a-cf0a-4aa2-93a1-68fdfa808959 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:46.919279 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96926b6a-cf0a-4aa2-93a1-68fdfa808959 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:46.920608 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96926b6a-cf0a-4aa2-93a1-68fdfa808959 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:46.942797 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-0c0805b6-1efb-4d9a-a8dd-b7680b6e654b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:46.953786 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-0c0805b6-1efb-4d9a-a8dd-b7680b6e654b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.257070 May 12 09:34:46.954504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 108/200] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:46 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:47.089624 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-96926b6a-cf0a-4aa2-93a1-68fdfa808959 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:47.100597 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-96926b6a-cf0a-4aa2-93a1-68fdfa808959 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.197314 May 12 09:34:47.106941 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 93/201] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:46 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:47.712431 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ab3d2fc6-1812-4e39-9962-f3d544eed7cc tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:47.713229 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ab3d2fc6-1812-4e39-9962-f3d544eed7cc tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:47.719474 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab3d2fc6-1812-4e39-9962-f3d544eed7cc tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:47.719819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab3d2fc6-1812-4e39-9962-f3d544eed7cc tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:47.720596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab3d2fc6-1812-4e39-9962-f3d544eed7cc tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:47.721032 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab3d2fc6-1812-4e39-9962-f3d544eed7cc tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:47.740228 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-22d2b503-ca0b-4c17-9e80-c995abc284cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:47.741011 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-22d2b503-ca0b-4c17-9e80-c995abc284cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:47.747384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-22d2b503-ca0b-4c17-9e80-c995abc284cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:47.748138 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-22d2b503-ca0b-4c17-9e80-c995abc284cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:47.748915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-22d2b503-ca0b-4c17-9e80-c995abc284cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:47.749352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-22d2b503-ca0b-4c17-9e80-c995abc284cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:47.953782 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ab3d2fc6-1812-4e39-9962-f3d544eed7cc tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:47.962784 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ab3d2fc6-1812-4e39-9962-f3d544eed7cc tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.255264 May 12 09:34:47.963467 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 109/202] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:47 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:47.967958 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-22d2b503-ca0b-4c17-9e80-c995abc284cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:47.971317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b51f32d5-95c0-4682-8829-83da9ee07307 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:47.972545 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b51f32d5-95c0-4682-8829-83da9ee07307 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:47.978566 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-22d2b503-ca0b-4c17-9e80-c995abc284cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.243253 May 12 09:34:47.979749 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 94/203] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:47 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:47.980314 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b51f32d5-95c0-4682-8829-83da9ee07307 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:47.980825 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b51f32d5-95c0-4682-8829-83da9ee07307 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:47.982013 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b51f32d5-95c0-4682-8829-83da9ee07307 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:47.982445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b51f32d5-95c0-4682-8829-83da9ee07307 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:48.114095 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b51f32d5-95c0-4682-8829-83da9ee07307 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:48.122519 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-efabb4cb-e956-455f-a91e-26ce74702f9a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:48.123120 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-efabb4cb-e956-455f-a91e-26ce74702f9a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:48.125808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b51f32d5-95c0-4682-8829-83da9ee07307 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.158759 May 12 09:34:48.126603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 110/204] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:47 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:48.129351 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efabb4cb-e956-455f-a91e-26ce74702f9a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:48.129797 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efabb4cb-e956-455f-a91e-26ce74702f9a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:48.130604 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efabb4cb-e956-455f-a91e-26ce74702f9a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:48.131085 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efabb4cb-e956-455f-a91e-26ce74702f9a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:48.267957 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-efabb4cb-e956-455f-a91e-26ce74702f9a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:48.275693 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-efabb4cb-e956-455f-a91e-26ce74702f9a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.156682 May 12 09:34:48.276274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 95/205] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:48 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:48.979988 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ea02b8d7-1b61-49e2-8696-bfa06072b5f5 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:48.980872 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ea02b8d7-1b61-49e2-8696-bfa06072b5f5 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:48.988015 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ea02b8d7-1b61-49e2-8696-bfa06072b5f5 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:48.988737 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ea02b8d7-1b61-49e2-8696-bfa06072b5f5 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:48.990207 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ea02b8d7-1b61-49e2-8696-bfa06072b5f5 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:48.991102 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ea02b8d7-1b61-49e2-8696-bfa06072b5f5 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:48.996160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-bda2fdb2-8975-4a04-a62c-29ae95a6d8bc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:48.997579 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-bda2fdb2-8975-4a04-a62c-29ae95a6d8bc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:49.003725 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bda2fdb2-8975-4a04-a62c-29ae95a6d8bc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:49.004246 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bda2fdb2-8975-4a04-a62c-29ae95a6d8bc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:49.005076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bda2fdb2-8975-4a04-a62c-29ae95a6d8bc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:49.005570 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bda2fdb2-8975-4a04-a62c-29ae95a6d8bc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:49.205402 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ea02b8d7-1b61-49e2-8696-bfa06072b5f5 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:49.213155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-bda2fdb2-8975-4a04-a62c-29ae95a6d8bc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:49.214445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ea02b8d7-1b61-49e2-8696-bfa06072b5f5 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.238269 May 12 09:34:49.215228 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 111/206] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:48 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:49.224534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-bda2fdb2-8975-4a04-a62c-29ae95a6d8bc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.232510 May 12 09:34:49.226514 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 96/207] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:48 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:49.228776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a0f4d078-35d4-4a84-a0cc-5bf0f3a2f924 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:49.229621 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a0f4d078-35d4-4a84-a0cc-5bf0f3a2f924 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:49.236463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0f4d078-35d4-4a84-a0cc-5bf0f3a2f924 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:49.236918 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0f4d078-35d4-4a84-a0cc-5bf0f3a2f924 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:49.237709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0f4d078-35d4-4a84-a0cc-5bf0f3a2f924 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:49.238174 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0f4d078-35d4-4a84-a0cc-5bf0f3a2f924 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:49.294892 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-719b421d-0b13-4186-8628-727925bf1601 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:49.295982 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-719b421d-0b13-4186-8628-727925bf1601 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:49.302450 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-719b421d-0b13-4186-8628-727925bf1601 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:49.303374 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-719b421d-0b13-4186-8628-727925bf1601 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:49.304362 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-719b421d-0b13-4186-8628-727925bf1601 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:49.304941 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-719b421d-0b13-4186-8628-727925bf1601 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:49.433829 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a0f4d078-35d4-4a84-a0cc-5bf0f3a2f924 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:49.441725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a0f4d078-35d4-4a84-a0cc-5bf0f3a2f924 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.225215 May 12 09:34:49.442340 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 112/208] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:49 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:49.508865 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-719b421d-0b13-4186-8628-727925bf1601 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:49.517521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-719b421d-0b13-4186-8628-727925bf1601 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.227436 May 12 09:34:49.518643 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 97/209] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:49 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:50.232562 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8ee0cab1-f1a5-4e72-bf96-7c8986019a2c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:50.233167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8ee0cab1-f1a5-4e72-bf96-7c8986019a2c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:50.242555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-218730fc-d852-424f-8059-d34b0728af39 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:50.244011 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-218730fc-d852-424f-8059-d34b0728af39 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:50.250666 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8ee0cab1-f1a5-4e72-bf96-7c8986019a2c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:50.253330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8ee0cab1-f1a5-4e72-bf96-7c8986019a2c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:50.255194 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-218730fc-d852-424f-8059-d34b0728af39 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:50.255730 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-218730fc-d852-424f-8059-d34b0728af39 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:50.257102 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-218730fc-d852-424f-8059-d34b0728af39 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:50.258124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8ee0cab1-f1a5-4e72-bf96-7c8986019a2c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:50.258614 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-218730fc-d852-424f-8059-d34b0728af39 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:50.259541 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8ee0cab1-f1a5-4e72-bf96-7c8986019a2c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:50.505191 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8ee0cab1-f1a5-4e72-bf96-7c8986019a2c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:50.514936 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8ee0cab1-f1a5-4e72-bf96-7c8986019a2c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.286844 May 12 09:34:50.526497 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 113/210] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:50 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:50.529673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-218730fc-d852-424f-8059-d34b0728af39 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:50.532573 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c18cee8c-2021-41cd-9ee6-3eb513e33498 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:50.533253 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c18cee8c-2021-41cd-9ee6-3eb513e33498 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:50.540969 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c18cee8c-2021-41cd-9ee6-3eb513e33498 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:50.541434 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c18cee8c-2021-41cd-9ee6-3eb513e33498 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:50.542522 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c18cee8c-2021-41cd-9ee6-3eb513e33498 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:50.543171 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c18cee8c-2021-41cd-9ee6-3eb513e33498 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:50.571605 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-218730fc-d852-424f-8059-d34b0728af39 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1363 microversion: 2.1 time: 0.332745 May 12 09:34:50.573750 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 98/211] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:50 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:50.607240 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c9eedcf1-59ab-498f-bb2a-1b367ecde7aa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:50.607867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c9eedcf1-59ab-498f-bb2a-1b367ecde7aa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:50.627267 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c9eedcf1-59ab-498f-bb2a-1b367ecde7aa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:50.627733 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c9eedcf1-59ab-498f-bb2a-1b367ecde7aa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:50.630979 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c9eedcf1-59ab-498f-bb2a-1b367ecde7aa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:50.633587 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c9eedcf1-59ab-498f-bb2a-1b367ecde7aa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:51.201366 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c18cee8c-2021-41cd-9ee6-3eb513e33498 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:51.216843 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c18cee8c-2021-41cd-9ee6-3eb513e33498 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.688876 May 12 09:34:51.220815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 114/212] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:50 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:51.433433 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c9eedcf1-59ab-498f-bb2a-1b367ecde7aa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:51.446621 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c9eedcf1-59ab-498f-bb2a-1b367ecde7aa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.870023 May 12 09:34:51.448467 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 99/213] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:50 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:51.532732 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b2e6a737-2cff-4622-be01-4f0e9439f44b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:51.533341 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b2e6a737-2cff-4622-be01-4f0e9439f44b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:51.543362 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b2e6a737-2cff-4622-be01-4f0e9439f44b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:51.549169 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b2e6a737-2cff-4622-be01-4f0e9439f44b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:51.550561 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b2e6a737-2cff-4622-be01-4f0e9439f44b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:51.551209 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b2e6a737-2cff-4622-be01-4f0e9439f44b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:51.590869 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-46771926-d5e6-4970-a3ab-309178439466 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:51.591978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-46771926-d5e6-4970-a3ab-309178439466 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:51.605990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-46771926-d5e6-4970-a3ab-309178439466 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:51.610687 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-46771926-d5e6-4970-a3ab-309178439466 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:51.614219 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-46771926-d5e6-4970-a3ab-309178439466 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:51.616051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-46771926-d5e6-4970-a3ab-309178439466 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:52.211882 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b2e6a737-2cff-4622-be01-4f0e9439f44b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:52.220997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b2e6a737-2cff-4622-be01-4f0e9439f44b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.692215 May 12 09:34:52.233808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 115/214] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:51 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:52.237522 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-fcf23655-ad6a-4d91-b004-0d2166630993 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:52.238164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-fcf23655-ad6a-4d91-b004-0d2166630993 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:52.255152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fcf23655-ad6a-4d91-b004-0d2166630993 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:52.255600 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fcf23655-ad6a-4d91-b004-0d2166630993 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:52.259358 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fcf23655-ad6a-4d91-b004-0d2166630993 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:52.263474 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fcf23655-ad6a-4d91-b004-0d2166630993 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:52.286704 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-46771926-d5e6-4970-a3ab-309178439466 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:52.295977 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-46771926-d5e6-4970-a3ab-309178439466 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1549 microversion: 2.1 time: 0.709010 May 12 09:34:52.297418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 100/215] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:51 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1549 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:52.313743 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e0948e0d-2082-402c-92e0-25b1504aabc1 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:52.314275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e0948e0d-2082-402c-92e0-25b1504aabc1 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:52.323770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e0948e0d-2082-402c-92e0-25b1504aabc1 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:52.324300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e0948e0d-2082-402c-92e0-25b1504aabc1 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:52.325071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e0948e0d-2082-402c-92e0-25b1504aabc1 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:52.325499 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e0948e0d-2082-402c-92e0-25b1504aabc1 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:52.542161 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e0948e0d-2082-402c-92e0-25b1504aabc1 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231846 May 12 09:34:52.543818 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 101/216] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 12 09:34:52 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:34:52.558607 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-10e3532e-1c51-4e28-9104-5a5660417006 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:52.560172 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-10e3532e-1c51-4e28-9104-5a5660417006 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:52.578405 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-10e3532e-1c51-4e28-9104-5a5660417006 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:52.580463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-10e3532e-1c51-4e28-9104-5a5660417006 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:52.583739 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-10e3532e-1c51-4e28-9104-5a5660417006 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:52.584733 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-10e3532e-1c51-4e28-9104-5a5660417006 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:52.656558 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-fcf23655-ad6a-4d91-b004-0d2166630993 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:52.672016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-fcf23655-ad6a-4d91-b004-0d2166630993 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.437448 May 12 09:34:52.673930 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 116/217] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:52 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:53.243961 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-968c2603-ae1e-4efd-8d61-9878950f1561 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:53.244819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-968c2603-ae1e-4efd-8d61-9878950f1561 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:53.289965 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-968c2603-ae1e-4efd-8d61-9878950f1561 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:53.290457 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-968c2603-ae1e-4efd-8d61-9878950f1561 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:53.292504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-968c2603-ae1e-4efd-8d61-9878950f1561 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:53.294486 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-968c2603-ae1e-4efd-8d61-9878950f1561 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:53.724457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-10e3532e-1c51-4e28-9104-5a5660417006 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:53.734127 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-10e3532e-1c51-4e28-9104-5a5660417006 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 1.188875 May 12 09:34:53.737183 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 102/218] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:52 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:53.770231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1bdf242f-c9dc-4276-8863-29937ce0166e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:53.773997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1bdf242f-c9dc-4276-8863-29937ce0166e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:53.794513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1bdf242f-c9dc-4276-8863-29937ce0166e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:53.795349 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1bdf242f-c9dc-4276-8863-29937ce0166e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:53.796362 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1bdf242f-c9dc-4276-8863-29937ce0166e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:53.797065 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1bdf242f-c9dc-4276-8863-29937ce0166e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:54.003344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-968c2603-ae1e-4efd-8d61-9878950f1561 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:54.021003 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-968c2603-ae1e-4efd-8d61-9878950f1561 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.783510 May 12 09:34:54.021599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 117/219] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:53 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:54.364274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1bdf242f-c9dc-4276-8863-29937ce0166e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:54.382900 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1bdf242f-c9dc-4276-8863-29937ce0166e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.615421 May 12 09:34:54.385026 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 103/220] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:53 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:54.763302 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b72ecb22-70f4-4d9f-82c9-3a664ff7e5f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:54.766895 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b72ecb22-70f4-4d9f-82c9-3a664ff7e5f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:54.796907 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b72ecb22-70f4-4d9f-82c9-3a664ff7e5f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:54.797381 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b72ecb22-70f4-4d9f-82c9-3a664ff7e5f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:54.798866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b72ecb22-70f4-4d9f-82c9-3a664ff7e5f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:54.799317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b72ecb22-70f4-4d9f-82c9-3a664ff7e5f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:55.037972 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-84b6a1fc-b712-4964-8d99-2313ef02fbff tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:55.039463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-84b6a1fc-b712-4964-8d99-2313ef02fbff tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:55.046232 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-84b6a1fc-b712-4964-8d99-2313ef02fbff tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:55.046668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-84b6a1fc-b712-4964-8d99-2313ef02fbff tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:55.056279 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-84b6a1fc-b712-4964-8d99-2313ef02fbff tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:55.056731 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-84b6a1fc-b712-4964-8d99-2313ef02fbff tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:55.468536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b72ecb22-70f4-4d9f-82c9-3a664ff7e5f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:55.479483 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b72ecb22-70f4-4d9f-82c9-3a664ff7e5f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.729482 May 12 09:34:55.485797 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-84b6a1fc-b712-4964-8d99-2313ef02fbff tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:55.493697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-84b6a1fc-b712-4964-8d99-2313ef02fbff tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.460176 May 12 09:34:55.497343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 104/221] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:55 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:55.500491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 118/222] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:54 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:55.507385 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-58fdf09f-cc2e-40c5-99ef-7dd5342ef7d4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:55.519386 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-58fdf09f-cc2e-40c5-99ef-7dd5342ef7d4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:55.526998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-58fdf09f-cc2e-40c5-99ef-7dd5342ef7d4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:55.527446 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-58fdf09f-cc2e-40c5-99ef-7dd5342ef7d4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:55.528226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-58fdf09f-cc2e-40c5-99ef-7dd5342ef7d4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:55.528662 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-58fdf09f-cc2e-40c5-99ef-7dd5342ef7d4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:55.900016 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-58fdf09f-cc2e-40c5-99ef-7dd5342ef7d4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:55.913244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-f58795c0-d186-4ae6-bf3b-7651197c2a30 req-2444bc5c-d984-4efa-b0cc-b5bb95dc0e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dadb998-7d24-461d-bf2f-cec5ab30fb48", "tag": "c4a1fbd1-1e2f-4367-8cd0-c2f3b5182c2b"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:55.931821 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-58fdf09f-cc2e-40c5-99ef-7dd5342ef7d4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.433012 May 12 09:34:55.936624 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f58795c0-d186-4ae6-bf3b-7651197c2a30 req-2444bc5c-d984-4efa-b0cc-b5bb95dc0e2e service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:55.937274 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f58795c0-d186-4ae6-bf3b-7651197c2a30 req-2444bc5c-d984-4efa-b0cc-b5bb95dc0e2e service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:55.943834 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 105/223] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:55 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:55.968199 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-f58795c0-d186-4ae6-bf3b-7651197c2a30 req-2444bc5c-d984-4efa-b0cc-b5bb95dc0e2e service nova] Creating event network-changed:c4a1fbd1-1e2f-4367-8cd0-c2f3b5182c2b for instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 on hv-cinder-83769 May 12 09:34:55.979449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-f58795c0-d186-4ae6-bf3b-7651197c2a30 req-2444bc5c-d984-4efa-b0cc-b5bb95dc0e2e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070813 May 12 09:34:55.984535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 119/224] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:56.514668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c5e39c5e-b47f-4561-b8ef-a75c6172daca tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:56.515293 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c5e39c5e-b47f-4561-b8ef-a75c6172daca tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:56.516249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b5813156-3c0d-47da-ac35-a2411ff7cffb tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:56.517004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b5813156-3c0d-47da-ac35-a2411ff7cffb tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:56.530067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b5813156-3c0d-47da-ac35-a2411ff7cffb tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:56.531667 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b5813156-3c0d-47da-ac35-a2411ff7cffb tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:56.533949 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b5813156-3c0d-47da-ac35-a2411ff7cffb tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:56.534534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c5e39c5e-b47f-4561-b8ef-a75c6172daca tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:56.534704 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b5813156-3c0d-47da-ac35-a2411ff7cffb tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:56.535516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c5e39c5e-b47f-4561-b8ef-a75c6172daca tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:56.536998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c5e39c5e-b47f-4561-b8ef-a75c6172daca tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:56.538779 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c5e39c5e-b47f-4561-b8ef-a75c6172daca tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:57.054156 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b5813156-3c0d-47da-ac35-a2411ff7cffb tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:57.063481 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b5813156-3c0d-47da-ac35-a2411ff7cffb tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.551314 May 12 09:34:57.066226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 120/225] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:56 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:57.073156 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d8736c8f-358a-4e57-89bb-dad1226e20a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:57.074159 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d8736c8f-358a-4e57-89bb-dad1226e20a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:57.092586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d8736c8f-358a-4e57-89bb-dad1226e20a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:57.094754 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d8736c8f-358a-4e57-89bb-dad1226e20a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:57.095784 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c5e39c5e-b47f-4561-b8ef-a75c6172daca tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:57.096451 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d8736c8f-358a-4e57-89bb-dad1226e20a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:57.097643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d8736c8f-358a-4e57-89bb-dad1226e20a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:57.129294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c5e39c5e-b47f-4561-b8ef-a75c6172daca tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.612267 May 12 09:34:57.133277 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 106/226] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:56 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:57.741811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d8736c8f-358a-4e57-89bb-dad1226e20a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:57.771442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d8736c8f-358a-4e57-89bb-dad1226e20a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1368 microversion: 2.1 time: 0.703940 May 12 09:34:57.773570 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 121/227] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:57 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1368 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:58.082964 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-451d3bc4-b863-447a-b03b-8d036040970c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:58.084291 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-451d3bc4-b863-447a-b03b-8d036040970c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:58.102073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-451d3bc4-b863-447a-b03b-8d036040970c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:58.102761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-451d3bc4-b863-447a-b03b-8d036040970c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:58.103539 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-451d3bc4-b863-447a-b03b-8d036040970c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:58.104000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-451d3bc4-b863-447a-b03b-8d036040970c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:58.147874 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b57a8e8f-b8a8-48e5-80e5-7c292df88cd3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:58.148843 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b57a8e8f-b8a8-48e5-80e5-7c292df88cd3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:58.162368 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b57a8e8f-b8a8-48e5-80e5-7c292df88cd3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:58.167478 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b57a8e8f-b8a8-48e5-80e5-7c292df88cd3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:58.172055 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b57a8e8f-b8a8-48e5-80e5-7c292df88cd3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:58.173084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b57a8e8f-b8a8-48e5-80e5-7c292df88cd3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:59.056904 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-451d3bc4-b863-447a-b03b-8d036040970c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:59.068474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-451d3bc4-b863-447a-b03b-8d036040970c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.988856 May 12 09:34:59.071819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 107/228] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:58 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:59.080882 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-11a73488-b8b1-45ae-b377-999dd6a145fb req-565dcbdd-4d03-4b1c-9320-c04cd4197ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d9ed2f-fe3d-46fc-a250-33724264ef93", "name": "network-vif-plugged", "status": "completed", "tag": "35189b62-b72a-41d7-be6e-95a6288505a1"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:34:59.104756 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-11a73488-b8b1-45ae-b377-999dd6a145fb req-565dcbdd-4d03-4b1c-9320-c04cd4197ced service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:59.105939 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-11a73488-b8b1-45ae-b377-999dd6a145fb req-565dcbdd-4d03-4b1c-9320-c04cd4197ced service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:59.118421 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b57a8e8f-b8a8-48e5-80e5-7c292df88cd3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:59.127940 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-11a73488-b8b1-45ae-b377-999dd6a145fb req-565dcbdd-4d03-4b1c-9320-c04cd4197ced service nova] Creating event network-vif-plugged:35189b62-b72a-41d7-be6e-95a6288505a1 for instance 53d9ed2f-fe3d-46fc-a250-33724264ef93 on hv-cinder-83769 May 12 09:34:59.128326 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b57a8e8f-b8a8-48e5-80e5-7c292df88cd3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.985111 May 12 09:34:59.128928 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 122/229] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:58 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:34:59.135356 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-737ce87d-0aa3-4b28-9c7c-5a02cf8a3783 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:59.136169 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-737ce87d-0aa3-4b28-9c7c-5a02cf8a3783 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:59.136290 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-11a73488-b8b1-45ae-b377-999dd6a145fb req-565dcbdd-4d03-4b1c-9320-c04cd4197ced service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062491 May 12 09:34:59.137203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 108/230] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:34:59.162782 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-737ce87d-0aa3-4b28-9c7c-5a02cf8a3783 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:59.164544 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-737ce87d-0aa3-4b28-9c7c-5a02cf8a3783 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:59.166853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-737ce87d-0aa3-4b28-9c7c-5a02cf8a3783 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:59.168075 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-737ce87d-0aa3-4b28-9c7c-5a02cf8a3783 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:59.423568 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-737ce87d-0aa3-4b28-9c7c-5a02cf8a3783 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:34:59.431871 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-737ce87d-0aa3-4b28-9c7c-5a02cf8a3783 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1558 microversion: 2.1 time: 0.301927 May 12 09:34:59.445964 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 123/231] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:34:59 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1558 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:34:59.456028 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-87198ae9-0048-4074-9eb1-5c445b1a1a71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:34:59.456876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-87198ae9-0048-4074-9eb1-5c445b1a1a71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:34:59.463686 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-87198ae9-0048-4074-9eb1-5c445b1a1a71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:59.464281 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-87198ae9-0048-4074-9eb1-5c445b1a1a71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:59.465149 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-87198ae9-0048-4074-9eb1-5c445b1a1a71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:34:59.465681 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-87198ae9-0048-4074-9eb1-5c445b1a1a71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:34:59.580997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-87198ae9-0048-4074-9eb1-5c445b1a1a71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132127 May 12 09:34:59.588130 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 109/232] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 12 09:34:59 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:35:00.095767 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d1c2a9aa-a38c-4d66-a87d-f4cffffd9360 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:00.096626 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d1c2a9aa-a38c-4d66-a87d-f4cffffd9360 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:00.106176 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d1c2a9aa-a38c-4d66-a87d-f4cffffd9360 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:00.112692 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d1c2a9aa-a38c-4d66-a87d-f4cffffd9360 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:00.113776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d1c2a9aa-a38c-4d66-a87d-f4cffffd9360 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:00.114413 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d1c2a9aa-a38c-4d66-a87d-f4cffffd9360 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:00.144679 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ed848fef-4f2a-4c15-be02-acda346492a1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:00.145959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ed848fef-4f2a-4c15-be02-acda346492a1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:00.158023 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ed848fef-4f2a-4c15-be02-acda346492a1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:00.158847 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ed848fef-4f2a-4c15-be02-acda346492a1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:00.159830 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ed848fef-4f2a-4c15-be02-acda346492a1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:00.161323 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ed848fef-4f2a-4c15-be02-acda346492a1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:00.363610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d1c2a9aa-a38c-4d66-a87d-f4cffffd9360 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:00.375895 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d1c2a9aa-a38c-4d66-a87d-f4cffffd9360 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.290243 May 12 09:35:00.385554 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 124/233] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:00 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:00.434991 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ed848fef-4f2a-4c15-be02-acda346492a1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:00.448573 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ed848fef-4f2a-4c15-be02-acda346492a1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.301520 May 12 09:35:00.449533 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 110/234] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:00 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:01.392796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-947cd2ff-1ba5-4567-a8ee-913991d3d75d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:01.393568 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-947cd2ff-1ba5-4567-a8ee-913991d3d75d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:01.406830 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-947cd2ff-1ba5-4567-a8ee-913991d3d75d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:01.407615 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-947cd2ff-1ba5-4567-a8ee-913991d3d75d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:01.410788 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-947cd2ff-1ba5-4567-a8ee-913991d3d75d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:01.411436 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-947cd2ff-1ba5-4567-a8ee-913991d3d75d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:01.467765 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-753969d1-f798-43bb-bf22-7e85cb56f2e3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:01.470934 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-753969d1-f798-43bb-bf22-7e85cb56f2e3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:01.495389 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-753969d1-f798-43bb-bf22-7e85cb56f2e3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:01.499352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-753969d1-f798-43bb-bf22-7e85cb56f2e3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:01.500253 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-753969d1-f798-43bb-bf22-7e85cb56f2e3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:01.500701 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-753969d1-f798-43bb-bf22-7e85cb56f2e3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:01.627564 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-947cd2ff-1ba5-4567-a8ee-913991d3d75d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:01.643843 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-947cd2ff-1ba5-4567-a8ee-913991d3d75d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.254802 May 12 09:35:01.645663 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 125/235] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:01 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:01.751268 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-753969d1-f798-43bb-bf22-7e85cb56f2e3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:01.759768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-753969d1-f798-43bb-bf22-7e85cb56f2e3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.298003 May 12 09:35:01.760730 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 111/236] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:01 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:01.970205 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-934c138a-4b78-4c52-a22c-2fabb57ee8ef req-5e570c4f-816c-4f15-bd69-9b0a25c315c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc90e8c3-13f2-4b3e-91e8-396847cf6572", "tag": "332c08c8-a0fb-4e00-b6b4-9b038555668c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:35:01.983740 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-934c138a-4b78-4c52-a22c-2fabb57ee8ef req-5e570c4f-816c-4f15-bd69-9b0a25c315c3 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:01.984180 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-934c138a-4b78-4c52-a22c-2fabb57ee8ef req-5e570c4f-816c-4f15-bd69-9b0a25c315c3 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:02.006386 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-934c138a-4b78-4c52-a22c-2fabb57ee8ef req-5e570c4f-816c-4f15-bd69-9b0a25c315c3 service nova] Creating event network-changed:332c08c8-a0fb-4e00-b6b4-9b038555668c for instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 on hv-cinder-83769 May 12 09:35:02.013620 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-934c138a-4b78-4c52-a22c-2fabb57ee8ef req-5e570c4f-816c-4f15-bd69-9b0a25c315c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047507 May 12 09:35:02.014927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 126/237] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:35:02.661473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-12bfde91-0193-40ba-a70e-c18dfb6129a5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:02.662711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-12bfde91-0193-40ba-a70e-c18dfb6129a5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:02.671653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-12bfde91-0193-40ba-a70e-c18dfb6129a5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:02.672776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-12bfde91-0193-40ba-a70e-c18dfb6129a5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:02.672776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-12bfde91-0193-40ba-a70e-c18dfb6129a5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:02.677481 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-12bfde91-0193-40ba-a70e-c18dfb6129a5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:02.777581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-815d9c9d-833d-4d75-a290-f3bedc53f5f8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:02.778946 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-815d9c9d-833d-4d75-a290-f3bedc53f5f8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:02.789868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-815d9c9d-833d-4d75-a290-f3bedc53f5f8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:02.803724 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-815d9c9d-833d-4d75-a290-f3bedc53f5f8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:02.805452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-815d9c9d-833d-4d75-a290-f3bedc53f5f8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:02.806244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-815d9c9d-833d-4d75-a290-f3bedc53f5f8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:02.974620 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-12bfde91-0193-40ba-a70e-c18dfb6129a5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:02.982690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-12bfde91-0193-40ba-a70e-c18dfb6129a5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.324957 May 12 09:35:02.983429 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 112/238] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:02 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:03.074054 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-815d9c9d-833d-4d75-a290-f3bedc53f5f8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:03.082693 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-815d9c9d-833d-4d75-a290-f3bedc53f5f8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.309192 May 12 09:35:03.083703 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 127/239] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:02 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:04.000246 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-39b720b8-8d3b-41e2-b086-344b606b2713 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:04.001005 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-39b720b8-8d3b-41e2-b086-344b606b2713 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:04.008014 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-39b720b8-8d3b-41e2-b086-344b606b2713 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:04.009184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-39b720b8-8d3b-41e2-b086-344b606b2713 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:04.010221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-39b720b8-8d3b-41e2-b086-344b606b2713 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:04.010856 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-39b720b8-8d3b-41e2-b086-344b606b2713 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:04.100131 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d455fe37-14c6-4dd7-920e-36ec0f8b4465 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:04.101528 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d455fe37-14c6-4dd7-920e-36ec0f8b4465 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:04.118589 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d455fe37-14c6-4dd7-920e-36ec0f8b4465 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:04.119050 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d455fe37-14c6-4dd7-920e-36ec0f8b4465 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:04.119833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d455fe37-14c6-4dd7-920e-36ec0f8b4465 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:04.120270 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d455fe37-14c6-4dd7-920e-36ec0f8b4465 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:04.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-39b720b8-8d3b-41e2-b086-344b606b2713 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:04.208312 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-39b720b8-8d3b-41e2-b086-344b606b2713 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.212004 May 12 09:35:04.209046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 113/240] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:03 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:04.320581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d455fe37-14c6-4dd7-920e-36ec0f8b4465 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:04.328559 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d455fe37-14c6-4dd7-920e-36ec0f8b4465 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.232738 May 12 09:35:04.338804 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 128/241] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:04 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:05.229890 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e3b2026f-a577-4009-ab02-d080dd895cca tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:05.231293 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e3b2026f-a577-4009-ab02-d080dd895cca tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:05.247450 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e3b2026f-a577-4009-ab02-d080dd895cca tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:05.247915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e3b2026f-a577-4009-ab02-d080dd895cca tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:05.248779 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e3b2026f-a577-4009-ab02-d080dd895cca tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:05.249219 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e3b2026f-a577-4009-ab02-d080dd895cca tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:05.345955 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7799c55a-5321-4d1e-940f-2df9cdff659a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:05.346660 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7799c55a-5321-4d1e-940f-2df9cdff659a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:05.356488 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7799c55a-5321-4d1e-940f-2df9cdff659a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:05.357463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7799c55a-5321-4d1e-940f-2df9cdff659a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:05.360908 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7799c55a-5321-4d1e-940f-2df9cdff659a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:05.362406 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7799c55a-5321-4d1e-940f-2df9cdff659a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:05.408365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e3b2026f-a577-4009-ab02-d080dd895cca tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:05.417646 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e3b2026f-a577-4009-ab02-d080dd895cca tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.196937 May 12 09:35:05.419621 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 114/242] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:05 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:05.597033 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7799c55a-5321-4d1e-940f-2df9cdff659a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:05.605449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7799c55a-5321-4d1e-940f-2df9cdff659a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.263334 May 12 09:35:05.606277 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 129/243] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:05 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:06.442038 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6dd2a2ec-8c97-420f-bbe1-b243fdab3681 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:06.443474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6dd2a2ec-8c97-420f-bbe1-b243fdab3681 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:06.449941 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6dd2a2ec-8c97-420f-bbe1-b243fdab3681 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:06.450399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6dd2a2ec-8c97-420f-bbe1-b243fdab3681 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:06.451183 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6dd2a2ec-8c97-420f-bbe1-b243fdab3681 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:06.451785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6dd2a2ec-8c97-420f-bbe1-b243fdab3681 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:06.629588 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6dd2a2ec-8c97-420f-bbe1-b243fdab3681 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:06.632970 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-14afdf76-5f45-447c-83c3-8d4fb36722fa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:06.633583 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-14afdf76-5f45-447c-83c3-8d4fb36722fa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:06.646284 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6dd2a2ec-8c97-420f-bbe1-b243fdab3681 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.207541 May 12 09:35:06.651106 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-14afdf76-5f45-447c-83c3-8d4fb36722fa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:06.651574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 115/244] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:06 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:06.652802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-14afdf76-5f45-447c-83c3-8d4fb36722fa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:06.664657 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-14afdf76-5f45-447c-83c3-8d4fb36722fa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:06.665352 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-14afdf76-5f45-447c-83c3-8d4fb36722fa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:06.861053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-14afdf76-5f45-447c-83c3-8d4fb36722fa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:06.869767 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-14afdf76-5f45-447c-83c3-8d4fb36722fa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.245573 May 12 09:35:06.870464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 130/245] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:06 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:07.665404 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-940a6c0e-7064-45dd-818b-47f376066ba7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:07.666230 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-940a6c0e-7064-45dd-818b-47f376066ba7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:07.675011 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-940a6c0e-7064-45dd-818b-47f376066ba7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:07.675696 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-940a6c0e-7064-45dd-818b-47f376066ba7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:07.676651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-940a6c0e-7064-45dd-818b-47f376066ba7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:07.677243 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-940a6c0e-7064-45dd-818b-47f376066ba7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:07.829308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-940a6c0e-7064-45dd-818b-47f376066ba7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:07.861089 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-940a6c0e-7064-45dd-818b-47f376066ba7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.200397 May 12 09:35:07.862603 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 116/246] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:07 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:07.889505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-df144b2d-7d07-43df-adaa-fcb8b9b095e2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:07.890252 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-df144b2d-7d07-43df-adaa-fcb8b9b095e2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:07.897216 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-df144b2d-7d07-43df-adaa-fcb8b9b095e2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:07.898623 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-df144b2d-7d07-43df-adaa-fcb8b9b095e2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:07.899546 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-df144b2d-7d07-43df-adaa-fcb8b9b095e2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:07.899833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-df144b2d-7d07-43df-adaa-fcb8b9b095e2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:07.988104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-baac0f03-bef7-4199-b391-8cc02352e020 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Action: 'create', calling method: .version_select at 0x7f87264aa700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-554626583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVtOZ17UFQs62/fG+Krit+XG0kuJPDTF4aHFxDh+AxdCbHVsNpv0rzZdFGS+bn+y1auVp9+Cnls6tiacz0zhvxtzRlgNYxb5BzgmbsIhmO3/LelyQRFiithMMxuL/AIQA=="}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:35:08.003520 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-baac0f03-bef7-4199-b391-8cc02352e020 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Getting quotas for project bdc48145acde413e99299f029ad0cea9. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:35:08.007781 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-baac0f03-bef7-4199-b391-8cc02352e020 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Getting quotas for user 1174087be0a7412d8dbba6f4f56c3424 and project bdc48145acde413e99299f029ad0cea9. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:35:08.039423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-baac0f03-bef7-4199-b391-8cc02352e020 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055240 May 12 09:35:08.041951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 117/247] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:35:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:35:08.044470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-df144b2d-7d07-43df-adaa-fcb8b9b095e2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:08.054413 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-df144b2d-7d07-43df-adaa-fcb8b9b095e2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.169104 May 12 09:35:08.057096 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 131/248] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:07 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:08.154690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-916258545", "imageRef": "a030ff06-2eb9-466c-aa56-33f5f4f91cfa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-554626583", "networks": [{"uuid": "e0454948-435a-43ce-83c7-832b357b7693"}]}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:35:08.205698 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] validate_networks() for [('e0454948-435a-43ce-83c7-832b357b7693', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:35:08.566160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:35:08.566598 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:35:08.567075 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:35:08.567510 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:35:08.568054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:35:08.579459 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:08.579913 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:08.580804 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:08.581187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:08.598275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Getting quotas for project bdc48145acde413e99299f029ad0cea9. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:35:08.602778 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Getting quotas for user 1174087be0a7412d8dbba6f4f56c3424 and project bdc48145acde413e99299f029ad0cea9. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:35:08.614769 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:35:08.618254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a030ff06-2eb9-466c-aa56-33f5f4f91cfa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:35:08.666107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-57407e32-f90f-4a4a-b993-f69b621c89d4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515274 May 12 09:35:08.667075 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 118/249] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:35:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:35:08.676665 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8376df35-1d9a-4e52-87d2-dabc998fd0f6 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:08.677464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8376df35-1d9a-4e52-87d2-dabc998fd0f6 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:08.732179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8376df35-1d9a-4e52-87d2-dabc998fd0f6 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:08.743200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8376df35-1d9a-4e52-87d2-dabc998fd0f6 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1257 microversion: 2.1 time: 0.070098 May 12 09:35:08.744950 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 132/250] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:08 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:08.878301 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5f40280c-df0d-46e6-b613-8c71db0a52a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:08.879217 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5f40280c-df0d-46e6-b613-8c71db0a52a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:08.891600 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5f40280c-df0d-46e6-b613-8c71db0a52a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:08.892375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5f40280c-df0d-46e6-b613-8c71db0a52a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:08.893405 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5f40280c-df0d-46e6-b613-8c71db0a52a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:08.894177 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5f40280c-df0d-46e6-b613-8c71db0a52a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:09.044682 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5f40280c-df0d-46e6-b613-8c71db0a52a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:09.052130 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5f40280c-df0d-46e6-b613-8c71db0a52a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.177708 May 12 09:35:09.053576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 119/251] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:08 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:09.073064 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a93c7077-7df0-4e1b-99f4-6f8d6f98e9b8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:09.073731 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a93c7077-7df0-4e1b-99f4-6f8d6f98e9b8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:09.081430 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a93c7077-7df0-4e1b-99f4-6f8d6f98e9b8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:09.081879 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a93c7077-7df0-4e1b-99f4-6f8d6f98e9b8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:09.082781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a93c7077-7df0-4e1b-99f4-6f8d6f98e9b8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:09.083225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a93c7077-7df0-4e1b-99f4-6f8d6f98e9b8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:09.211978 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a93c7077-7df0-4e1b-99f4-6f8d6f98e9b8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:09.220226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a93c7077-7df0-4e1b-99f4-6f8d6f98e9b8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.151459 May 12 09:35:09.222524 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 133/252] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:09 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:09.764189 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8cc1796b-d968-4c84-9a65-c484d2c6b9be tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:09.764810 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8cc1796b-d968-4c84-9a65-c484d2c6b9be tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:09.770738 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8cc1796b-d968-4c84-9a65-c484d2c6b9be tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:09.771188 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8cc1796b-d968-4c84-9a65-c484d2c6b9be tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:09.772439 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8cc1796b-d968-4c84-9a65-c484d2c6b9be tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:09.772869 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8cc1796b-d968-4c84-9a65-c484d2c6b9be tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:09.830569 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8cc1796b-d968-4c84-9a65-c484d2c6b9be tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:09.838230 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8cc1796b-d968-4c84-9a65-c484d2c6b9be tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.077887 May 12 09:35:09.838787 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 120/253] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:09 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:10.069967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e128d6f4-0d7b-4101-a7d2-6a6096f978e5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:10.070725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e128d6f4-0d7b-4101-a7d2-6a6096f978e5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:10.077177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e128d6f4-0d7b-4101-a7d2-6a6096f978e5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:10.077819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e128d6f4-0d7b-4101-a7d2-6a6096f978e5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:10.078501 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e128d6f4-0d7b-4101-a7d2-6a6096f978e5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:10.078928 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e128d6f4-0d7b-4101-a7d2-6a6096f978e5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:10.215702 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e128d6f4-0d7b-4101-a7d2-6a6096f978e5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:10.222992 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e128d6f4-0d7b-4101-a7d2-6a6096f978e5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.157596 May 12 09:35:10.223558 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 134/254] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:10 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:10.237734 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-edac81a1-1384-4418-84cd-94d8b336d451 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:10.238388 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-edac81a1-1384-4418-84cd-94d8b336d451 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:10.244720 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-edac81a1-1384-4418-84cd-94d8b336d451 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:10.245167 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-edac81a1-1384-4418-84cd-94d8b336d451 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:10.245942 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-edac81a1-1384-4418-84cd-94d8b336d451 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:10.246684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-edac81a1-1384-4418-84cd-94d8b336d451 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:10.373540 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-edac81a1-1384-4418-84cd-94d8b336d451 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:10.380762 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-edac81a1-1384-4418-84cd-94d8b336d451 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.147154 May 12 09:35:10.381328 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 121/255] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:10 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:10.855555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-beafbfe0-f47e-401d-98c8-b95510b418df tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:10.856170 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-beafbfe0-f47e-401d-98c8-b95510b418df tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:10.862055 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-beafbfe0-f47e-401d-98c8-b95510b418df tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:10.862502 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-beafbfe0-f47e-401d-98c8-b95510b418df tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:10.863249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-beafbfe0-f47e-401d-98c8-b95510b418df tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:10.863677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-beafbfe0-f47e-401d-98c8-b95510b418df tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:10.920866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-beafbfe0-f47e-401d-98c8-b95510b418df tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:10.928643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-beafbfe0-f47e-401d-98c8-b95510b418df tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.076989 May 12 09:35:10.929204 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 135/256] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:10 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:11.239450 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2a756847-63e1-4870-b327-2d2292a19742 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:11.240552 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2a756847-63e1-4870-b327-2d2292a19742 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:11.246705 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2a756847-63e1-4870-b327-2d2292a19742 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:11.247179 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2a756847-63e1-4870-b327-2d2292a19742 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:11.247936 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2a756847-63e1-4870-b327-2d2292a19742 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:11.248365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2a756847-63e1-4870-b327-2d2292a19742 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:11.376336 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2a756847-63e1-4870-b327-2d2292a19742 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:11.384301 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2a756847-63e1-4870-b327-2d2292a19742 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.148394 May 12 09:35:11.384863 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 122/257] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:11 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:11.398919 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3e5400cd-f74a-4b0b-85f0-0a64523fe624 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:11.399608 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3e5400cd-f74a-4b0b-85f0-0a64523fe624 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:11.406096 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3e5400cd-f74a-4b0b-85f0-0a64523fe624 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:11.406547 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3e5400cd-f74a-4b0b-85f0-0a64523fe624 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:11.407335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3e5400cd-f74a-4b0b-85f0-0a64523fe624 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:11.407758 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3e5400cd-f74a-4b0b-85f0-0a64523fe624 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:11.532646 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3e5400cd-f74a-4b0b-85f0-0a64523fe624 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:11.540375 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3e5400cd-f74a-4b0b-85f0-0a64523fe624 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.146041 May 12 09:35:11.540939 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 136/258] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:11 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:11.945214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b299d06a-7bbc-4240-98f5-7a77b26f9f83 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:11.945817 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b299d06a-7bbc-4240-98f5-7a77b26f9f83 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:11.951742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b299d06a-7bbc-4240-98f5-7a77b26f9f83 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:11.952190 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b299d06a-7bbc-4240-98f5-7a77b26f9f83 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:11.952948 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b299d06a-7bbc-4240-98f5-7a77b26f9f83 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:11.953380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b299d06a-7bbc-4240-98f5-7a77b26f9f83 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:12.013878 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b299d06a-7bbc-4240-98f5-7a77b26f9f83 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:12.021063 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b299d06a-7bbc-4240-98f5-7a77b26f9f83 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.080354 May 12 09:35:12.022166 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 123/259] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:11 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:12.401681 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-46818ec7-4161-4571-97ec-feedb65daacf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:12.402318 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-46818ec7-4161-4571-97ec-feedb65daacf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:12.408538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-46818ec7-4161-4571-97ec-feedb65daacf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:12.408989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-46818ec7-4161-4571-97ec-feedb65daacf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:12.409751 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-46818ec7-4161-4571-97ec-feedb65daacf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:12.410225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-46818ec7-4161-4571-97ec-feedb65daacf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:12.548298 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-46818ec7-4161-4571-97ec-feedb65daacf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:12.556053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-46818ec7-4161-4571-97ec-feedb65daacf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.158521 May 12 09:35:12.556613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 137/260] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:12 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:12.556950 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4cb8a086-852d-4827-ad85-eee27ed9de06 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:12.557645 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4cb8a086-852d-4827-ad85-eee27ed9de06 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:12.563549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cb8a086-852d-4827-ad85-eee27ed9de06 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:12.563997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cb8a086-852d-4827-ad85-eee27ed9de06 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:12.564757 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cb8a086-852d-4827-ad85-eee27ed9de06 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:12.565191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cb8a086-852d-4827-ad85-eee27ed9de06 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:12.694216 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4cb8a086-852d-4827-ad85-eee27ed9de06 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:12.701456 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4cb8a086-852d-4827-ad85-eee27ed9de06 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.148825 May 12 09:35:12.702044 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 124/261] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:12 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:13.039192 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a7271f18-7e4b-4f67-ac0f-431d51375500 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:13.039795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a7271f18-7e4b-4f67-ac0f-431d51375500 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:13.045661 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a7271f18-7e4b-4f67-ac0f-431d51375500 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:13.046148 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a7271f18-7e4b-4f67-ac0f-431d51375500 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:13.046902 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a7271f18-7e4b-4f67-ac0f-431d51375500 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:13.047332 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a7271f18-7e4b-4f67-ac0f-431d51375500 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:13.109776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a7271f18-7e4b-4f67-ac0f-431d51375500 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:13.117839 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a7271f18-7e4b-4f67-ac0f-431d51375500 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.083193 May 12 09:35:13.118438 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 138/262] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:13 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:13.572651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a0002366-8bd9-4b6a-b3e1-0587859b22dd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:13.573281 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a0002366-8bd9-4b6a-b3e1-0587859b22dd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:13.579152 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a0002366-8bd9-4b6a-b3e1-0587859b22dd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:13.579596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a0002366-8bd9-4b6a-b3e1-0587859b22dd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:13.580343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a0002366-8bd9-4b6a-b3e1-0587859b22dd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:13.580771 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a0002366-8bd9-4b6a-b3e1-0587859b22dd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:13.706290 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a0002366-8bd9-4b6a-b3e1-0587859b22dd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:13.713494 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a0002366-8bd9-4b6a-b3e1-0587859b22dd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.144686 May 12 09:35:13.714089 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 125/263] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:13 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:13.718234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-89a175b7-682a-41c3-b54d-c6d6ac30dbb2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:13.718843 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-89a175b7-682a-41c3-b54d-c6d6ac30dbb2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:13.725655 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-89a175b7-682a-41c3-b54d-c6d6ac30dbb2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:13.726135 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-89a175b7-682a-41c3-b54d-c6d6ac30dbb2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:13.726907 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-89a175b7-682a-41c3-b54d-c6d6ac30dbb2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:13.727346 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-89a175b7-682a-41c3-b54d-c6d6ac30dbb2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:13.854221 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-89a175b7-682a-41c3-b54d-c6d6ac30dbb2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:13.861390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-89a175b7-682a-41c3-b54d-c6d6ac30dbb2 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.146922 May 12 09:35:13.861982 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 139/264] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:13 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:14.135442 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-98ab63b1-b380-446d-ab5d-fe853d1f5463 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:14.136090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-98ab63b1-b380-446d-ab5d-fe853d1f5463 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:14.141921 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-98ab63b1-b380-446d-ab5d-fe853d1f5463 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:14.142403 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-98ab63b1-b380-446d-ab5d-fe853d1f5463 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:14.143178 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-98ab63b1-b380-446d-ab5d-fe853d1f5463 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:14.143614 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-98ab63b1-b380-446d-ab5d-fe853d1f5463 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:14.204223 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-98ab63b1-b380-446d-ab5d-fe853d1f5463 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:14.211443 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-98ab63b1-b380-446d-ab5d-fe853d1f5463 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.080906 May 12 09:35:14.212018 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 126/265] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:14 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:14.730239 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-be4fa0cb-c21c-451b-80ad-3ba3e0ebd4ae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:14.730847 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-be4fa0cb-c21c-451b-80ad-3ba3e0ebd4ae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:14.737127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-be4fa0cb-c21c-451b-80ad-3ba3e0ebd4ae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:14.737583 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-be4fa0cb-c21c-451b-80ad-3ba3e0ebd4ae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:14.738385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-be4fa0cb-c21c-451b-80ad-3ba3e0ebd4ae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:14.738826 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-be4fa0cb-c21c-451b-80ad-3ba3e0ebd4ae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:14.874719 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-be4fa0cb-c21c-451b-80ad-3ba3e0ebd4ae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:14.880036 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-525d6db3-434a-43bf-af62-0d6a9bd6f322 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:14.881248 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-525d6db3-434a-43bf-af62-0d6a9bd6f322 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:14.882535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-be4fa0cb-c21c-451b-80ad-3ba3e0ebd4ae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.156139 May 12 09:35:14.883103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 140/266] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:14 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:14.887416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-525d6db3-434a-43bf-af62-0d6a9bd6f322 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:14.887861 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-525d6db3-434a-43bf-af62-0d6a9bd6f322 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:14.888612 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-525d6db3-434a-43bf-af62-0d6a9bd6f322 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:14.889041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-525d6db3-434a-43bf-af62-0d6a9bd6f322 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:15.015884 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-525d6db3-434a-43bf-af62-0d6a9bd6f322 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:15.023203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-525d6db3-434a-43bf-af62-0d6a9bd6f322 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.146883 May 12 09:35:15.023773 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 127/267] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:14 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:15.228776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a2b6f1a4-eb88-46d6-af58-8c41c93d8897 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:15.229347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a2b6f1a4-eb88-46d6-af58-8c41c93d8897 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:15.235776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a2b6f1a4-eb88-46d6-af58-8c41c93d8897 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:15.236220 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a2b6f1a4-eb88-46d6-af58-8c41c93d8897 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:15.236999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a2b6f1a4-eb88-46d6-af58-8c41c93d8897 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:15.237419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a2b6f1a4-eb88-46d6-af58-8c41c93d8897 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:15.300298 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a2b6f1a4-eb88-46d6-af58-8c41c93d8897 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:15.308637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a2b6f1a4-eb88-46d6-af58-8c41c93d8897 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.084326 May 12 09:35:15.309380 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 141/268] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:15 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:15.899661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-38e83c65-6bac-41a4-a675-b0253183a4f5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:15.900257 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-38e83c65-6bac-41a4-a675-b0253183a4f5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:15.906340 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-38e83c65-6bac-41a4-a675-b0253183a4f5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:15.906799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-38e83c65-6bac-41a4-a675-b0253183a4f5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:15.907557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-38e83c65-6bac-41a4-a675-b0253183a4f5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:15.907989 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-38e83c65-6bac-41a4-a675-b0253183a4f5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:16.036435 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-38e83c65-6bac-41a4-a675-b0253183a4f5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:16.040858 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-39dca104-371f-4073-bf20-90f1e26fbb35 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:16.041520 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-39dca104-371f-4073-bf20-90f1e26fbb35 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:16.048431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-38e83c65-6bac-41a4-a675-b0253183a4f5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.152591 May 12 09:35:16.049019 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 128/269] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:15 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:16.049135 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39dca104-371f-4073-bf20-90f1e26fbb35 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:16.049725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39dca104-371f-4073-bf20-90f1e26fbb35 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:16.051051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39dca104-371f-4073-bf20-90f1e26fbb35 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:16.051855 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39dca104-371f-4073-bf20-90f1e26fbb35 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:16.177583 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-39dca104-371f-4073-bf20-90f1e26fbb35 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:16.185250 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-39dca104-371f-4073-bf20-90f1e26fbb35 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.149048 May 12 09:35:16.185815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 142/270] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:16 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:16.324848 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7c5db165-22ac-43bf-a053-1472a7cd76ea tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:16.325449 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7c5db165-22ac-43bf-a053-1472a7cd76ea tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:16.331288 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7c5db165-22ac-43bf-a053-1472a7cd76ea tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:16.331727 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7c5db165-22ac-43bf-a053-1472a7cd76ea tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:16.332476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7c5db165-22ac-43bf-a053-1472a7cd76ea tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:16.332903 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7c5db165-22ac-43bf-a053-1472a7cd76ea tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:16.392504 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7c5db165-22ac-43bf-a053-1472a7cd76ea tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:16.399577 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7c5db165-22ac-43bf-a053-1472a7cd76ea tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.078500 May 12 09:35:16.400137 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 129/271] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:16 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:17.067621 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6308a495-05cf-4f34-b2b8-7cc37973cc24 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:17.068256 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6308a495-05cf-4f34-b2b8-7cc37973cc24 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:17.075231 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6308a495-05cf-4f34-b2b8-7cc37973cc24 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:17.075695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6308a495-05cf-4f34-b2b8-7cc37973cc24 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:17.076464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6308a495-05cf-4f34-b2b8-7cc37973cc24 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:17.076904 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6308a495-05cf-4f34-b2b8-7cc37973cc24 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:17.202134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c33f6776-911e-43f0-89f6-6eaa9c7f9990 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:17.202845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c33f6776-911e-43f0-89f6-6eaa9c7f9990 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:17.209519 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c33f6776-911e-43f0-89f6-6eaa9c7f9990 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:17.209994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c33f6776-911e-43f0-89f6-6eaa9c7f9990 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:17.210777 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c33f6776-911e-43f0-89f6-6eaa9c7f9990 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:17.211207 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c33f6776-911e-43f0-89f6-6eaa9c7f9990 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:17.466370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6308a495-05cf-4f34-b2b8-7cc37973cc24 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:17.472751 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6308a495-05cf-4f34-b2b8-7cc37973cc24 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.408743 May 12 09:35:17.473334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 143/272] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:17 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:17.478354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-45ded33c-6c08-4652-8421-e44ef558eded tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:17.478960 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-45ded33c-6c08-4652-8421-e44ef558eded tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:17.484593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-45ded33c-6c08-4652-8421-e44ef558eded tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:17.485045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-45ded33c-6c08-4652-8421-e44ef558eded tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:17.485809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-45ded33c-6c08-4652-8421-e44ef558eded tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:17.486297 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-45ded33c-6c08-4652-8421-e44ef558eded tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:17.487196 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c33f6776-911e-43f0-89f6-6eaa9c7f9990 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:17.495005 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c33f6776-911e-43f0-89f6-6eaa9c7f9990 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.296824 May 12 09:35:17.495578 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 130/273] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:17 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:17.547340 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-45ded33c-6c08-4652-8421-e44ef558eded tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:17.554484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-45ded33c-6c08-4652-8421-e44ef558eded tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.080218 May 12 09:35:17.555051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 144/274] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:17 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:18.490324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-80ed3117-0c6e-4421-b573-622492ff3c7e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:18.490941 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-80ed3117-0c6e-4421-b573-622492ff3c7e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:18.496932 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80ed3117-0c6e-4421-b573-622492ff3c7e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:18.497387 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80ed3117-0c6e-4421-b573-622492ff3c7e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:18.498198 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80ed3117-0c6e-4421-b573-622492ff3c7e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:18.498638 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80ed3117-0c6e-4421-b573-622492ff3c7e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:18.514806 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ade89543-42d1-479a-ba02-5b12a2ba0132 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:18.516054 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ade89543-42d1-479a-ba02-5b12a2ba0132 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:18.522664 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ade89543-42d1-479a-ba02-5b12a2ba0132 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:18.523115 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ade89543-42d1-479a-ba02-5b12a2ba0132 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:18.523894 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ade89543-42d1-479a-ba02-5b12a2ba0132 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:18.524366 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ade89543-42d1-479a-ba02-5b12a2ba0132 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:18.689051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-80ed3117-0c6e-4421-b573-622492ff3c7e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:18.697118 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-80ed3117-0c6e-4421-b573-622492ff3c7e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.211095 May 12 09:35:18.697424 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ade89543-42d1-479a-ba02-5b12a2ba0132 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:18.697756 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 131/275] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:18 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:18.702300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f22c4a59-dae4-407d-879c-fd0ca1708b4b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:18.702947 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f22c4a59-dae4-407d-879c-fd0ca1708b4b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:18.705283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ade89543-42d1-479a-ba02-5b12a2ba0132 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.194872 May 12 09:35:18.705951 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 145/276] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:18 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:18.708795 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f22c4a59-dae4-407d-879c-fd0ca1708b4b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:18.709252 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f22c4a59-dae4-407d-879c-fd0ca1708b4b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:18.710038 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f22c4a59-dae4-407d-879c-fd0ca1708b4b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:18.710479 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f22c4a59-dae4-407d-879c-fd0ca1708b4b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:18.771664 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f22c4a59-dae4-407d-879c-fd0ca1708b4b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:18.779265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f22c4a59-dae4-407d-879c-fd0ca1708b4b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.080596 May 12 09:35:18.779834 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 132/277] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:18 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:19.714241 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ea458d0a-1fd1-44ae-95b8-80d75ccfd415 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:19.714837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ea458d0a-1fd1-44ae-95b8-80d75ccfd415 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:19.721663 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ea458d0a-1fd1-44ae-95b8-80d75ccfd415 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:19.722082 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-654cc976-3bc0-4754-987f-cc7da90d701c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:19.722721 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ea458d0a-1fd1-44ae-95b8-80d75ccfd415 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:19.722836 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-654cc976-3bc0-4754-987f-cc7da90d701c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:19.722942 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ea458d0a-1fd1-44ae-95b8-80d75ccfd415 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:19.723587 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ea458d0a-1fd1-44ae-95b8-80d75ccfd415 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:19.730452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-654cc976-3bc0-4754-987f-cc7da90d701c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:19.730903 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-654cc976-3bc0-4754-987f-cc7da90d701c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:19.731677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-654cc976-3bc0-4754-987f-cc7da90d701c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:19.732108 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-654cc976-3bc0-4754-987f-cc7da90d701c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:19.914555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ea458d0a-1fd1-44ae-95b8-80d75ccfd415 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:19.917790 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-654cc976-3bc0-4754-987f-cc7da90d701c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:19.921833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ea458d0a-1fd1-44ae-95b8-80d75ccfd415 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.211385 May 12 09:35:19.922419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 146/278] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:19 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:19.925028 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-654cc976-3bc0-4754-987f-cc7da90d701c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.206824 May 12 09:35:19.925734 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 133/279] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:19 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:19.928009 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d15f25de-4ec9-4e2a-9f1f-4084ce3a7a52 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:19.928727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d15f25de-4ec9-4e2a-9f1f-4084ce3a7a52 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:19.934923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d15f25de-4ec9-4e2a-9f1f-4084ce3a7a52 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:19.935520 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d15f25de-4ec9-4e2a-9f1f-4084ce3a7a52 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:19.936437 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d15f25de-4ec9-4e2a-9f1f-4084ce3a7a52 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:19.936873 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d15f25de-4ec9-4e2a-9f1f-4084ce3a7a52 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:19.995227 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d15f25de-4ec9-4e2a-9f1f-4084ce3a7a52 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:20.002529 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d15f25de-4ec9-4e2a-9f1f-4084ce3a7a52 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.079157 May 12 09:35:20.003095 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 147/280] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:19 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:20.939921 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-68dc77ed-d6f5-462b-bddc-4c7a612876b3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:20.940761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-68dc77ed-d6f5-462b-bddc-4c7a612876b3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:20.943770 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7762d618-34f1-457c-a57a-7c53e0474c92 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:20.944390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7762d618-34f1-457c-a57a-7c53e0474c92 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:20.950306 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68dc77ed-d6f5-462b-bddc-4c7a612876b3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:20.951379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7762d618-34f1-457c-a57a-7c53e0474c92 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:20.951557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68dc77ed-d6f5-462b-bddc-4c7a612876b3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:20.951833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7762d618-34f1-457c-a57a-7c53e0474c92 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:20.952567 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68dc77ed-d6f5-462b-bddc-4c7a612876b3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:20.952684 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7762d618-34f1-457c-a57a-7c53e0474c92 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:20.953013 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68dc77ed-d6f5-462b-bddc-4c7a612876b3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:20.953123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7762d618-34f1-457c-a57a-7c53e0474c92 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:21.147075 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7762d618-34f1-457c-a57a-7c53e0474c92 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:21.150019 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-68dc77ed-d6f5-462b-bddc-4c7a612876b3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:21.155227 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7762d618-34f1-457c-a57a-7c53e0474c92 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.215387 May 12 09:35:21.156190 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 148/281] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:20 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:21.157863 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-68dc77ed-d6f5-462b-bddc-4c7a612876b3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.222389 May 12 09:35:21.161192 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6f7a91ba-4887-4e7d-8b13-e6c49ba942c4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:21.162545 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6f7a91ba-4887-4e7d-8b13-e6c49ba942c4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:21.166168 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 134/282] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:20 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:21.169775 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f7a91ba-4887-4e7d-8b13-e6c49ba942c4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:21.170286 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f7a91ba-4887-4e7d-8b13-e6c49ba942c4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:21.171104 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f7a91ba-4887-4e7d-8b13-e6c49ba942c4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:21.171505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f7a91ba-4887-4e7d-8b13-e6c49ba942c4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:21.237768 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6f7a91ba-4887-4e7d-8b13-e6c49ba942c4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:21.247053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6f7a91ba-4887-4e7d-8b13-e6c49ba942c4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.089569 May 12 09:35:21.247876 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 149/283] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:21 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:22.173679 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a498dfcd-b80e-41cc-ac7e-989b8d3fdef4 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:22.174390 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a498dfcd-b80e-41cc-ac7e-989b8d3fdef4 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:22.175340 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-fd08cfa7-4d4b-4897-afb7-c44aa6798d42 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:22.175941 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-fd08cfa7-4d4b-4897-afb7-c44aa6798d42 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:22.180472 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a498dfcd-b80e-41cc-ac7e-989b8d3fdef4 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:22.180913 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a498dfcd-b80e-41cc-ac7e-989b8d3fdef4 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:22.181665 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a498dfcd-b80e-41cc-ac7e-989b8d3fdef4 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:22.182140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a498dfcd-b80e-41cc-ac7e-989b8d3fdef4 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:22.183464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fd08cfa7-4d4b-4897-afb7-c44aa6798d42 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:22.183912 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fd08cfa7-4d4b-4897-afb7-c44aa6798d42 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:22.184669 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fd08cfa7-4d4b-4897-afb7-c44aa6798d42 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:22.185181 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fd08cfa7-4d4b-4897-afb7-c44aa6798d42 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:22.370463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-fd08cfa7-4d4b-4897-afb7-c44aa6798d42 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:22.376880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a498dfcd-b80e-41cc-ac7e-989b8d3fdef4 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:22.377614 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-fd08cfa7-4d4b-4897-afb7-c44aa6798d42 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.206534 May 12 09:35:22.378219 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 150/284] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:22 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:22.383234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a1b962f6-648f-4914-97a9-50df83c399f9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:22.383838 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a1b962f6-648f-4914-97a9-50df83c399f9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:22.386129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a498dfcd-b80e-41cc-ac7e-989b8d3fdef4 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.216430 May 12 09:35:22.395191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 135/285] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:22 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:22.395334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a1b962f6-648f-4914-97a9-50df83c399f9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:22.395334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a1b962f6-648f-4914-97a9-50df83c399f9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:22.395334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a1b962f6-648f-4914-97a9-50df83c399f9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:22.395334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a1b962f6-648f-4914-97a9-50df83c399f9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:22.451718 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a1b962f6-648f-4914-97a9-50df83c399f9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:22.459042 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a1b962f6-648f-4914-97a9-50df83c399f9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.079889 May 12 09:35:22.459613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 151/286] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:22 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:23.395425 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-70a8e353-cebf-4007-aed1-60332b0236f3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:23.397751 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-70a8e353-cebf-4007-aed1-60332b0236f3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:23.403074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b6f0a9a4-9e47-49be-98c7-a40fba2b9ece tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:23.403639 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b6f0a9a4-9e47-49be-98c7-a40fba2b9ece tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:23.404050 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70a8e353-cebf-4007-aed1-60332b0236f3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:23.405812 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70a8e353-cebf-4007-aed1-60332b0236f3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:23.406735 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70a8e353-cebf-4007-aed1-60332b0236f3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:23.407385 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70a8e353-cebf-4007-aed1-60332b0236f3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:23.410440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b6f0a9a4-9e47-49be-98c7-a40fba2b9ece tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:23.410974 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b6f0a9a4-9e47-49be-98c7-a40fba2b9ece tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:23.413140 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b6f0a9a4-9e47-49be-98c7-a40fba2b9ece tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:23.413772 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b6f0a9a4-9e47-49be-98c7-a40fba2b9ece tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:23.597610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-70a8e353-cebf-4007-aed1-60332b0236f3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:23.602243 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b6f0a9a4-9e47-49be-98c7-a40fba2b9ece tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:23.605508 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-70a8e353-cebf-4007-aed1-60332b0236f3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.213876 May 12 09:35:23.606100 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 136/287] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:23 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:23.609695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b6f0a9a4-9e47-49be-98c7-a40fba2b9ece tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.210645 May 12 09:35:23.610283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 152/288] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:23 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:23.610672 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6025e4a4-a1ee-479a-bdf5-12106ee00029 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:23.611320 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6025e4a4-a1ee-479a-bdf5-12106ee00029 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:23.617498 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6025e4a4-a1ee-479a-bdf5-12106ee00029 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:23.618082 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6025e4a4-a1ee-479a-bdf5-12106ee00029 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:23.618841 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6025e4a4-a1ee-479a-bdf5-12106ee00029 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:23.619268 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6025e4a4-a1ee-479a-bdf5-12106ee00029 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:23.688025 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6025e4a4-a1ee-479a-bdf5-12106ee00029 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:23.695531 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6025e4a4-a1ee-479a-bdf5-12106ee00029 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1261 microversion: 2.1 time: 0.088452 May 12 09:35:23.696107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 137/289] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:23 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:23.977816 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-5c9b1696-8b74-4079-8397-201145a6ebfe req-6ec1c939-ff2e-4431-bfed-438644fefb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d286f5-766e-42c0-a80c-4526ac1b3829", "name": "network-vif-plugged", "status": "completed", "tag": "50f1df2b-d761-4daf-aea9-a81a341d7a3c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:35:23.987079 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-5c9b1696-8b74-4079-8397-201145a6ebfe req-6ec1c939-ff2e-4431-bfed-438644fefb99 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:23.987523 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-5c9b1696-8b74-4079-8397-201145a6ebfe req-6ec1c939-ff2e-4431-bfed-438644fefb99 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:24.000270 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-5c9b1696-8b74-4079-8397-201145a6ebfe req-6ec1c939-ff2e-4431-bfed-438644fefb99 service nova] Creating event network-vif-plugged:50f1df2b-d761-4daf-aea9-a81a341d7a3c for instance 56d286f5-766e-42c0-a80c-4526ac1b3829 on hv-cinder-83769 May 12 09:35:24.005485 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-5c9b1696-8b74-4079-8397-201145a6ebfe req-6ec1c939-ff2e-4431-bfed-438644fefb99 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032219 May 12 09:35:24.006321 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 153/290] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:35:24.622118 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f448b1bb-e3a8-4a33-b4db-ec9198b55987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:24.622723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f448b1bb-e3a8-4a33-b4db-ec9198b55987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:24.627883 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-31d89fa9-40be-4ccc-90df-435c7bd9e218 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:24.628647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-31d89fa9-40be-4ccc-90df-435c7bd9e218 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:24.636582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-31d89fa9-40be-4ccc-90df-435c7bd9e218 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:24.636928 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f448b1bb-e3a8-4a33-b4db-ec9198b55987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:24.637193 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f448b1bb-e3a8-4a33-b4db-ec9198b55987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:24.637354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-31d89fa9-40be-4ccc-90df-435c7bd9e218 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:24.638206 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f448b1bb-e3a8-4a33-b4db-ec9198b55987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:24.638320 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-31d89fa9-40be-4ccc-90df-435c7bd9e218 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:24.638808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f448b1bb-e3a8-4a33-b4db-ec9198b55987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:24.638945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-31d89fa9-40be-4ccc-90df-435c7bd9e218 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:24.826716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f448b1bb-e3a8-4a33-b4db-ec9198b55987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:24.829863 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-31d89fa9-40be-4ccc-90df-435c7bd9e218 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:24.834213 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f448b1bb-e3a8-4a33-b4db-ec9198b55987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.215806 May 12 09:35:24.834799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 138/291] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:24 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:24.837392 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-31d89fa9-40be-4ccc-90df-435c7bd9e218 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.213839 May 12 09:35:24.837987 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 154/292] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:24 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:24.840860 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c896f4e1-9f01-448b-a2a4-443dc83683ac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:24.842010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c896f4e1-9f01-448b-a2a4-443dc83683ac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:24.848916 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c896f4e1-9f01-448b-a2a4-443dc83683ac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:24.849367 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c896f4e1-9f01-448b-a2a4-443dc83683ac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:24.850160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c896f4e1-9f01-448b-a2a4-443dc83683ac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:24.850600 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c896f4e1-9f01-448b-a2a4-443dc83683ac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:24.916067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c896f4e1-9f01-448b-a2a4-443dc83683ac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:24.923599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c896f4e1-9f01-448b-a2a4-443dc83683ac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1309 microversion: 2.1 time: 0.087267 May 12 09:35:24.924215 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 139/293] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:24 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1309 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:25.621723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ab165539-53cf-4598-814e-886288b4fd47 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:25.622265 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ab165539-53cf-4598-814e-886288b4fd47 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:25.628112 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab165539-53cf-4598-814e-886288b4fd47 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:25.628806 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab165539-53cf-4598-814e-886288b4fd47 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:25.629283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab165539-53cf-4598-814e-886288b4fd47 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:25.629714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab165539-53cf-4598-814e-886288b4fd47 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:25.656539 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ab165539-53cf-4598-814e-886288b4fd47 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:35:25.749146 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ab165539-53cf-4598-814e-886288b4fd47 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 204 len: 0 microversion: 2.1 time: 0.131026 May 12 09:35:25.749842 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 155/294] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:35:25 2022] DELETE /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:35:25.758480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5bb159cd-f652-404a-b87b-cc7292d935af tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:25.759336 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5bb159cd-f652-404a-b87b-cc7292d935af tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:25.765336 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5bb159cd-f652-404a-b87b-cc7292d935af tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:25.765785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5bb159cd-f652-404a-b87b-cc7292d935af tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:25.766572 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5bb159cd-f652-404a-b87b-cc7292d935af tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:25.767007 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5bb159cd-f652-404a-b87b-cc7292d935af tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:25.853838 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b8781092-7792-405a-a589-5b3bafa8bd5f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:25.854549 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b8781092-7792-405a-a589-5b3bafa8bd5f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:25.861384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8781092-7792-405a-a589-5b3bafa8bd5f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:25.861831 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8781092-7792-405a-a589-5b3bafa8bd5f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:25.862661 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8781092-7792-405a-a589-5b3bafa8bd5f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:25.863096 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8781092-7792-405a-a589-5b3bafa8bd5f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:25.954494 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5bb159cd-f652-404a-b87b-cc7292d935af tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:25.968825 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5bb159cd-f652-404a-b87b-cc7292d935af tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1553 microversion: 2.1 time: 0.214736 May 12 09:35:25.969592 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 140/295] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:25 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:25.974844 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-054066b8-987e-4e5e-9303-695b8b775682 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:25.975439 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-054066b8-987e-4e5e-9303-695b8b775682 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:25.982088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-054066b8-987e-4e5e-9303-695b8b775682 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:25.983265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-054066b8-987e-4e5e-9303-695b8b775682 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:25.984425 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-054066b8-987e-4e5e-9303-695b8b775682 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:25.984835 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-054066b8-987e-4e5e-9303-695b8b775682 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:26.041697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b8781092-7792-405a-a589-5b3bafa8bd5f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:26.050841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b8781092-7792-405a-a589-5b3bafa8bd5f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.201025 May 12 09:35:26.052219 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 156/296] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:25 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:26.057913 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8b4a56cf-8463-4d94-a57d-54f8543e7f02 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:26.058577 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8b4a56cf-8463-4d94-a57d-54f8543e7f02 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:26.066277 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8b4a56cf-8463-4d94-a57d-54f8543e7f02 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:26.066851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8b4a56cf-8463-4d94-a57d-54f8543e7f02 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:26.067988 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8b4a56cf-8463-4d94-a57d-54f8543e7f02 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:26.069449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8b4a56cf-8463-4d94-a57d-54f8543e7f02 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:26.163993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8b4a56cf-8463-4d94-a57d-54f8543e7f02 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:26.171817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8b4a56cf-8463-4d94-a57d-54f8543e7f02 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1309 microversion: 2.1 time: 0.118314 May 12 09:35:26.172395 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 157/297] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:26 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:26.199766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-054066b8-987e-4e5e-9303-695b8b775682 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:26.207008 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-054066b8-987e-4e5e-9303-695b8b775682 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.236300 May 12 09:35:26.207584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 141/298] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:25 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:26.987228 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-29437e26-3127-4efa-a487-6de89b078d4e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:26.987983 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-29437e26-3127-4efa-a487-6de89b078d4e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:26.995984 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29437e26-3127-4efa-a487-6de89b078d4e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:26.996521 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29437e26-3127-4efa-a487-6de89b078d4e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:26.997358 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29437e26-3127-4efa-a487-6de89b078d4e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:26.997866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29437e26-3127-4efa-a487-6de89b078d4e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:27.072630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6f05d71c-f54f-46db-9b4d-dfa55981f9c9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:27.073328 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6f05d71c-f54f-46db-9b4d-dfa55981f9c9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:27.079303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f05d71c-f54f-46db-9b4d-dfa55981f9c9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:27.079825 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f05d71c-f54f-46db-9b4d-dfa55981f9c9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:27.080580 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f05d71c-f54f-46db-9b4d-dfa55981f9c9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:27.081183 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f05d71c-f54f-46db-9b4d-dfa55981f9c9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:27.191157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-29437e26-3127-4efa-a487-6de89b078d4e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:27.200182 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-29437e26-3127-4efa-a487-6de89b078d4e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1553 microversion: 2.1 time: 0.217379 May 12 09:35:27.209698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 158/299] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:26 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:27.209698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1be8e56f-acb4-4a82-be3d-60871fb22513 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:27.209698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1be8e56f-acb4-4a82-be3d-60871fb22513 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:27.214697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1be8e56f-acb4-4a82-be3d-60871fb22513 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:27.215221 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1be8e56f-acb4-4a82-be3d-60871fb22513 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:27.216058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1be8e56f-acb4-4a82-be3d-60871fb22513 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:27.216572 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1be8e56f-acb4-4a82-be3d-60871fb22513 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:27.237459 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6f05d71c-f54f-46db-9b4d-dfa55981f9c9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:27.247092 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6f05d71c-f54f-46db-9b4d-dfa55981f9c9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1322 microversion: 2.1 time: 0.179318 May 12 09:35:27.247684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 142/300] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:27 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:27.252573 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d0ae3a4a-ff6a-4ea6-bf1e-68085f2e57ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:27.253205 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d0ae3a4a-ff6a-4ea6-bf1e-68085f2e57ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:27.260461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0ae3a4a-ff6a-4ea6-bf1e-68085f2e57ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:27.260855 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0ae3a4a-ff6a-4ea6-bf1e-68085f2e57ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:27.261629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0ae3a4a-ff6a-4ea6-bf1e-68085f2e57ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:27.262098 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0ae3a4a-ff6a-4ea6-bf1e-68085f2e57ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:27.278848 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1be8e56f-acb4-4a82-be3d-60871fb22513 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:27.286173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1be8e56f-acb4-4a82-be3d-60871fb22513 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1317 microversion: 2.1 time: 0.083883 May 12 09:35:27.287613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 159/301] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:27 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1317 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:27.394807 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d0ae3a4a-ff6a-4ea6-bf1e-68085f2e57ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:27.404158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d0ae3a4a-ff6a-4ea6-bf1e-68085f2e57ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.155478 May 12 09:35:27.404730 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 143/302] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:27 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:28.216239 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e0e9a4eb-87c3-44e4-a48f-e9c4716a8473 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:28.216840 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e0e9a4eb-87c3-44e4-a48f-e9c4716a8473 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:28.222997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0e9a4eb-87c3-44e4-a48f-e9c4716a8473 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.223729 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0e9a4eb-87c3-44e4-a48f-e9c4716a8473 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.224999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0e9a4eb-87c3-44e4-a48f-e9c4716a8473 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.225429 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0e9a4eb-87c3-44e4-a48f-e9c4716a8473 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.264889 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-be97dfcb-7e22-4f4e-b05a-37eafa06a58f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:28.265576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-be97dfcb-7e22-4f4e-b05a-37eafa06a58f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:28.272704 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-be97dfcb-7e22-4f4e-b05a-37eafa06a58f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.273142 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-be97dfcb-7e22-4f4e-b05a-37eafa06a58f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.274495 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-be97dfcb-7e22-4f4e-b05a-37eafa06a58f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.274928 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-be97dfcb-7e22-4f4e-b05a-37eafa06a58f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.439918 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e0e9a4eb-87c3-44e4-a48f-e9c4716a8473 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:28.448013 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e0e9a4eb-87c3-44e4-a48f-e9c4716a8473 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1553 microversion: 2.1 time: 0.235461 May 12 09:35:28.448711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 160/303] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:28 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:28.453496 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6df96d0f-af6d-472b-a8c6-6c4b4e561f7c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:28.454353 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6df96d0f-af6d-472b-a8c6-6c4b4e561f7c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:28.461081 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6df96d0f-af6d-472b-a8c6-6c4b4e561f7c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.461687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6df96d0f-af6d-472b-a8c6-6c4b4e561f7c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.462699 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6df96d0f-af6d-472b-a8c6-6c4b4e561f7c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.463224 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6df96d0f-af6d-472b-a8c6-6c4b4e561f7c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.484411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-be97dfcb-7e22-4f4e-b05a-37eafa06a58f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:28.492706 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-be97dfcb-7e22-4f4e-b05a-37eafa06a58f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1515 microversion: 2.1 time: 0.231936 May 12 09:35:28.493552 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 144/304] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:28 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:28.498222 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a309cfe0-c402-431d-92ce-5adb958a44c8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:28.498990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a309cfe0-c402-431d-92ce-5adb958a44c8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:28.506056 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a309cfe0-c402-431d-92ce-5adb958a44c8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.506515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a309cfe0-c402-431d-92ce-5adb958a44c8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.507397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a309cfe0-c402-431d-92ce-5adb958a44c8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.508053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a309cfe0-c402-431d-92ce-5adb958a44c8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.543075 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6df96d0f-af6d-472b-a8c6-6c4b4e561f7c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:28.550588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6df96d0f-af6d-472b-a8c6-6c4b4e561f7c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1317 microversion: 2.1 time: 0.100716 May 12 09:35:28.551152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 161/305] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:28 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1317 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:28.556595 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-721e6b6d-cfde-40cb-93c2-8f8fe1ab4a37 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:35:28.557581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-721e6b6d-cfde-40cb-93c2-8f8fe1ab4a37 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:28.564717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-721e6b6d-cfde-40cb-93c2-8f8fe1ab4a37 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.565174 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-721e6b6d-cfde-40cb-93c2-8f8fe1ab4a37 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.565979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-721e6b6d-cfde-40cb-93c2-8f8fe1ab4a37 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.566417 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-721e6b6d-cfde-40cb-93c2-8f8fe1ab4a37 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.593287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-721e6b6d-cfde-40cb-93c2-8f8fe1ab4a37 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lazy-loading 'flavor' on Instance uuid 53d9ed2f-fe3d-46fc-a250-33724264ef93 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:35:28.702878 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a309cfe0-c402-431d-92ce-5adb958a44c8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:28.710793 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a309cfe0-c402-431d-92ce-5adb958a44c8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.215971 May 12 09:35:28.711742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 145/306] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:28 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:28.723081 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-721e6b6d-cfde-40cb-93c2-8f8fe1ab4a37 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93/action" status: 200 len: 32 microversion: 2.1 time: 0.170525 May 12 09:35:28.723700 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 162/307] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:35:28 2022] POST /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 09:35:28.733264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7d6efd62-65df-471e-8b56-645e05151a89 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:28.733959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7d6efd62-65df-471e-8b56-645e05151a89 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:28.740245 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d6efd62-65df-471e-8b56-645e05151a89 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.740696 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d6efd62-65df-471e-8b56-645e05151a89 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:28.741448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d6efd62-65df-471e-8b56-645e05151a89 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:28.741880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d6efd62-65df-471e-8b56-645e05151a89 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:29.029885 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7d6efd62-65df-471e-8b56-645e05151a89 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:29.037687 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7d6efd62-65df-471e-8b56-645e05151a89 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.308185 May 12 09:35:29.038414 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 146/308] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:28 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:29.467660 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bcd024c1-7cd4-4779-9a99-6bcab1a8fb69 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:29.469160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-bcd024c1-7cd4-4779-9a99-6bcab1a8fb69 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:29.479937 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bcd024c1-7cd4-4779-9a99-6bcab1a8fb69 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:29.480387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bcd024c1-7cd4-4779-9a99-6bcab1a8fb69 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:29.481379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bcd024c1-7cd4-4779-9a99-6bcab1a8fb69 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:29.481991 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bcd024c1-7cd4-4779-9a99-6bcab1a8fb69 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:29.568420 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-37717c8b-39ce-462f-bd1c-2dcc446443b0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:29.569655 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-37717c8b-39ce-462f-bd1c-2dcc446443b0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:29.576444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-37717c8b-39ce-462f-bd1c-2dcc446443b0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:29.576891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-37717c8b-39ce-462f-bd1c-2dcc446443b0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:29.577654 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-37717c8b-39ce-462f-bd1c-2dcc446443b0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:29.578109 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-37717c8b-39ce-462f-bd1c-2dcc446443b0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:29.639717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-bcd024c1-7cd4-4779-9a99-6bcab1a8fb69 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:29.647730 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-bcd024c1-7cd4-4779-9a99-6bcab1a8fb69 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1553 microversion: 2.1 time: 0.185852 May 12 09:35:29.648417 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 163/309] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:29 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:29.655534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-37717c8b-39ce-462f-bd1c-2dcc446443b0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:29.663718 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-37717c8b-39ce-462f-bd1c-2dcc446443b0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1327 microversion: 2.1 time: 0.099805 May 12 09:35:29.664306 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 147/310] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:29 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:29.729556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9c9d0dde-83f5-46bd-af4b-ac8f94b26f0f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:29.730202 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9c9d0dde-83f5-46bd-af4b-ac8f94b26f0f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:29.736172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9c9d0dde-83f5-46bd-af4b-ac8f94b26f0f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:29.736621 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9c9d0dde-83f5-46bd-af4b-ac8f94b26f0f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:29.737403 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9c9d0dde-83f5-46bd-af4b-ac8f94b26f0f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:29.737827 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9c9d0dde-83f5-46bd-af4b-ac8f94b26f0f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:29.920036 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9c9d0dde-83f5-46bd-af4b-ac8f94b26f0f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:29.927924 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9c9d0dde-83f5-46bd-af4b-ac8f94b26f0f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.202356 May 12 09:35:29.928578 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 164/311] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:29 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:30.054315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e817e153-cc30-4dfe-98c9-bb59c5b598ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:30.054915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e817e153-cc30-4dfe-98c9-bb59c5b598ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:30.060580 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e817e153-cc30-4dfe-98c9-bb59c5b598ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:30.061028 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e817e153-cc30-4dfe-98c9-bb59c5b598ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:30.061788 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e817e153-cc30-4dfe-98c9-bb59c5b598ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:30.062235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e817e153-cc30-4dfe-98c9-bb59c5b598ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:30.197368 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e817e153-cc30-4dfe-98c9-bb59c5b598ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:30.204644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e817e153-cc30-4dfe-98c9-bb59c5b598ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.154620 May 12 09:35:30.205276 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 148/312] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:30 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:30.664783 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-85d605d3-f773-4fff-a71e-e890c5ef7367 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:30.666925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-85d605d3-f773-4fff-a71e-e890c5ef7367 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:30.673453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-85d605d3-f773-4fff-a71e-e890c5ef7367 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:30.674039 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-85d605d3-f773-4fff-a71e-e890c5ef7367 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:30.674827 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-85d605d3-f773-4fff-a71e-e890c5ef7367 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:30.675273 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-85d605d3-f773-4fff-a71e-e890c5ef7367 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:30.680374 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-68274ca8-8b59-4294-a8bd-b4bb2c522dd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:30.681570 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-68274ca8-8b59-4294-a8bd-b4bb2c522dd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:30.687739 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68274ca8-8b59-4294-a8bd-b4bb2c522dd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:30.688466 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68274ca8-8b59-4294-a8bd-b4bb2c522dd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:30.689311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68274ca8-8b59-4294-a8bd-b4bb2c522dd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:30.689824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68274ca8-8b59-4294-a8bd-b4bb2c522dd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:30.767313 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-68274ca8-8b59-4294-a8bd-b4bb2c522dd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:30.776018 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-68274ca8-8b59-4294-a8bd-b4bb2c522dd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1327 microversion: 2.1 time: 0.099316 May 12 09:35:30.776799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 149/313] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:30 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:30.839803 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-85d605d3-f773-4fff-a71e-e890c5ef7367 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:30.850191 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-85d605d3-f773-4fff-a71e-e890c5ef7367 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1553 microversion: 2.1 time: 0.189683 May 12 09:35:30.851172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 165/314] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:30 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:30.944428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9842c410-437d-4329-a615-50089d3709c3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:30.945132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9842c410-437d-4329-a615-50089d3709c3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:30.951075 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9842c410-437d-4329-a615-50089d3709c3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:30.951533 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9842c410-437d-4329-a615-50089d3709c3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:30.952308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9842c410-437d-4329-a615-50089d3709c3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:30.952744 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9842c410-437d-4329-a615-50089d3709c3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:31.089188 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9842c410-437d-4329-a615-50089d3709c3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:31.096621 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9842c410-437d-4329-a615-50089d3709c3 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1318 microversion: 2.1 time: 0.156046 May 12 09:35:31.097257 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 150/315] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:30 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:31.221258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-da33950e-368d-43f0-8d70-3bf1cfd97f65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:31.222175 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-da33950e-368d-43f0-8d70-3bf1cfd97f65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:31.230825 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-da33950e-368d-43f0-8d70-3bf1cfd97f65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:31.231500 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-da33950e-368d-43f0-8d70-3bf1cfd97f65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:31.233412 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-da33950e-368d-43f0-8d70-3bf1cfd97f65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:31.234020 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-da33950e-368d-43f0-8d70-3bf1cfd97f65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:31.388766 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-da33950e-368d-43f0-8d70-3bf1cfd97f65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:31.396910 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-da33950e-368d-43f0-8d70-3bf1cfd97f65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.179898 May 12 09:35:31.406946 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 166/316] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:31 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:31.798144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d8905139-3589-4f93-ae1a-31a6a0ff9315 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:31.798144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d8905139-3589-4f93-ae1a-31a6a0ff9315 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:31.804512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d8905139-3589-4f93-ae1a-31a6a0ff9315 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:31.805083 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d8905139-3589-4f93-ae1a-31a6a0ff9315 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:31.805867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d8905139-3589-4f93-ae1a-31a6a0ff9315 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:31.806326 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d8905139-3589-4f93-ae1a-31a6a0ff9315 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:31.868800 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-78a441aa-ebe5-4fc7-943b-3a9c6aaabdaa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:31.869420 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-78a441aa-ebe5-4fc7-943b-3a9c6aaabdaa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:31.875978 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-78a441aa-ebe5-4fc7-943b-3a9c6aaabdaa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:31.876738 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-78a441aa-ebe5-4fc7-943b-3a9c6aaabdaa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:31.877617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-78a441aa-ebe5-4fc7-943b-3a9c6aaabdaa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:31.878098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-78a441aa-ebe5-4fc7-943b-3a9c6aaabdaa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:31.981751 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d8905139-3589-4f93-ae1a-31a6a0ff9315 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:31.991621 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d8905139-3589-4f93-ae1a-31a6a0ff9315 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.202876 May 12 09:35:31.992192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 151/317] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:31 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:32.028425 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-78a441aa-ebe5-4fc7-943b-3a9c6aaabdaa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:32.036163 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-78a441aa-ebe5-4fc7-943b-3a9c6aaabdaa tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1553 microversion: 2.1 time: 0.171867 May 12 09:35:32.037282 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 167/318] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:31 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:32.114473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-cca5b6ed-ad9f-4a6c-b6b9-ba78e134e83f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:32.115084 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-cca5b6ed-ad9f-4a6c-b6b9-ba78e134e83f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:32.121187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cca5b6ed-ad9f-4a6c-b6b9-ba78e134e83f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:32.121639 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cca5b6ed-ad9f-4a6c-b6b9-ba78e134e83f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:32.122448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cca5b6ed-ad9f-4a6c-b6b9-ba78e134e83f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:32.122865 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cca5b6ed-ad9f-4a6c-b6b9-ba78e134e83f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:32.290538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cca5b6ed-ad9f-4a6c-b6b9-ba78e134e83f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:32.297788 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-cca5b6ed-ad9f-4a6c-b6b9-ba78e134e83f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1506 microversion: 2.1 time: 0.187198 May 12 09:35:32.298382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 152/319] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:32 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:32.418651 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-87f18ea7-685c-44e9-a3ea-3b9471b7a4a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:32.421870 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-87f18ea7-685c-44e9-a3ea-3b9471b7a4a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:32.429806 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-87f18ea7-685c-44e9-a3ea-3b9471b7a4a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:32.434660 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-87f18ea7-685c-44e9-a3ea-3b9471b7a4a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:32.435722 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-87f18ea7-685c-44e9-a3ea-3b9471b7a4a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:32.436350 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-87f18ea7-685c-44e9-a3ea-3b9471b7a4a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:32.701996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-87f18ea7-685c-44e9-a3ea-3b9471b7a4a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:32.713018 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-87f18ea7-685c-44e9-a3ea-3b9471b7a4a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.303358 May 12 09:35:32.714209 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 168/320] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:32 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:33.009787 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-740d5f29-346a-40f2-970d-accf3ec47c40 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:33.010433 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-740d5f29-346a-40f2-970d-accf3ec47c40 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:33.019078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-740d5f29-346a-40f2-970d-accf3ec47c40 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:33.026609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-740d5f29-346a-40f2-970d-accf3ec47c40 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:33.027865 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-740d5f29-346a-40f2-970d-accf3ec47c40 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:33.028466 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-740d5f29-346a-40f2-970d-accf3ec47c40 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:33.055234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-572d0c73-3792-4b68-8a6b-fc0570c159b9 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:33.056491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-572d0c73-3792-4b68-8a6b-fc0570c159b9 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:33.066832 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-572d0c73-3792-4b68-8a6b-fc0570c159b9 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:33.067286 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-572d0c73-3792-4b68-8a6b-fc0570c159b9 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:33.068662 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-572d0c73-3792-4b68-8a6b-fc0570c159b9 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:33.069156 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-572d0c73-3792-4b68-8a6b-fc0570c159b9 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:33.363022 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-572d0c73-3792-4b68-8a6b-fc0570c159b9 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:33.378211 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-572d0c73-3792-4b68-8a6b-fc0570c159b9 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1553 microversion: 2.1 time: 0.326037 May 12 09:35:33.379452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 169/321] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:33 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1553 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:33.405798 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-740d5f29-346a-40f2-970d-accf3ec47c40 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:33.419079 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-740d5f29-346a-40f2-970d-accf3ec47c40 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.414177 May 12 09:35:33.420246 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 153/322] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:33 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:33.639818 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-8e210808-2ba7-4567-9f3f-93455be445b3 req-d1e08cd2-1a18-4b71-accf-47a8bee1d0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b658c976-df06-49bb-9c2d-4d42cead8156", "name": "network-vif-deleted", "tag": "a1f179d2-9260-4805-a962-5a7091a5b50a"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:35:33.651900 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-8e210808-2ba7-4567-9f3f-93455be445b3 req-d1e08cd2-1a18-4b71-accf-47a8bee1d0cd service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:33.652655 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-8e210808-2ba7-4567-9f3f-93455be445b3 req-d1e08cd2-1a18-4b71-accf-47a8bee1d0cd service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:33.690353 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-8e210808-2ba7-4567-9f3f-93455be445b3 req-d1e08cd2-1a18-4b71-accf-47a8bee1d0cd service nova] Creating event network-vif-deleted:a1f179d2-9260-4805-a962-5a7091a5b50a for instance b658c976-df06-49bb-9c2d-4d42cead8156 on hv-cinder-83769 May 12 09:35:33.702554 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-8e210808-2ba7-4567-9f3f-93455be445b3 req-d1e08cd2-1a18-4b71-accf-47a8bee1d0cd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067735 May 12 09:35:33.704002 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 170/323] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:35:33.731460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4e01f1e1-f3c4-4a89-9ac9-5d5ab60ef947 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:33.732105 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4e01f1e1-f3c4-4a89-9ac9-5d5ab60ef947 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:33.739919 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e01f1e1-f3c4-4a89-9ac9-5d5ab60ef947 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:33.743012 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e01f1e1-f3c4-4a89-9ac9-5d5ab60ef947 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:33.743975 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e01f1e1-f3c4-4a89-9ac9-5d5ab60ef947 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:33.744417 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e01f1e1-f3c4-4a89-9ac9-5d5ab60ef947 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:33.964796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4e01f1e1-f3c4-4a89-9ac9-5d5ab60ef947 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:33.972761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4e01f1e1-f3c4-4a89-9ac9-5d5ab60ef947 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.245499 May 12 09:35:33.977585 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 154/324] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:33 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:34.401406 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9283a491-6afd-4959-9391-56e89e82e1bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:34.402368 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9283a491-6afd-4959-9391-56e89e82e1bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:34.411811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9283a491-6afd-4959-9391-56e89e82e1bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:34.412631 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9283a491-6afd-4959-9391-56e89e82e1bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:34.413593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9283a491-6afd-4959-9391-56e89e82e1bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:34.414231 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9283a491-6afd-4959-9391-56e89e82e1bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:34.437080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-eaed776a-591b-4a98-a156-1659752a578a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:34.437950 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-eaed776a-591b-4a98-a156-1659752a578a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:34.444928 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eaed776a-591b-4a98-a156-1659752a578a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:34.445858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eaed776a-591b-4a98-a156-1659752a578a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:34.446874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eaed776a-591b-4a98-a156-1659752a578a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:34.447306 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eaed776a-591b-4a98-a156-1659752a578a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:34.516122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9283a491-6afd-4959-9391-56e89e82e1bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:34.524229 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9283a491-6afd-4959-9391-56e89e82e1bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.129918 May 12 09:35:34.525024 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 171/325] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:34 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:34.816093 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-eaed776a-591b-4a98-a156-1659752a578a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:34.823459 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-eaed776a-591b-4a98-a156-1659752a578a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.390584 May 12 09:35:34.824129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 155/326] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:34 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:34.993761 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0247b144-d5b5-45b0-a166-ca34ebb0fe3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:34.994417 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0247b144-d5b5-45b0-a166-ca34ebb0fe3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:35.000546 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0247b144-d5b5-45b0-a166-ca34ebb0fe3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:35.001002 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0247b144-d5b5-45b0-a166-ca34ebb0fe3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:35.001801 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0247b144-d5b5-45b0-a166-ca34ebb0fe3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:35.002283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0247b144-d5b5-45b0-a166-ca34ebb0fe3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:35.143129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-0247b144-d5b5-45b0-a166-ca34ebb0fe3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:35.151055 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-0247b144-d5b5-45b0-a166-ca34ebb0fe3e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.162360 May 12 09:35:35.151610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 172/327] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:34 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:35.542506 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8934720e-bb44-4b48-9809-f59ea2d73331 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:35.544133 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8934720e-bb44-4b48-9809-f59ea2d73331 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:35.556400 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8934720e-bb44-4b48-9809-f59ea2d73331 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:35.556919 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8934720e-bb44-4b48-9809-f59ea2d73331 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:35.557808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8934720e-bb44-4b48-9809-f59ea2d73331 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:35.558336 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8934720e-bb44-4b48-9809-f59ea2d73331 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:35.651152 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8934720e-bb44-4b48-9809-f59ea2d73331 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:35.659125 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8934720e-bb44-4b48-9809-f59ea2d73331 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.120602 May 12 09:35:35.659696 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 156/328] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:35 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:35.720097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-5739fcb1-68f3-41e9-acd2-f270b40aabe7 req-4b691c52-2aa6-49af-a2ac-e14ec42eca85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a158cc80-2631-4dba-8071-ef5e07ec8ba1", "tag": "3af65aa8-83b2-410d-b24d-4b9b1b6dd549"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:35:35.728334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-5739fcb1-68f3-41e9-acd2-f270b40aabe7 req-4b691c52-2aa6-49af-a2ac-e14ec42eca85 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:35.728769 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-5739fcb1-68f3-41e9-acd2-f270b40aabe7 req-4b691c52-2aa6-49af-a2ac-e14ec42eca85 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:35.739841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-5739fcb1-68f3-41e9-acd2-f270b40aabe7 req-4b691c52-2aa6-49af-a2ac-e14ec42eca85 service nova] Creating event network-changed:3af65aa8-83b2-410d-b24d-4b9b1b6dd549 for instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 on hv-cinder-83769 May 12 09:35:35.744550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-5739fcb1-68f3-41e9-acd2-f270b40aabe7 req-4b691c52-2aa6-49af-a2ac-e14ec42eca85 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028054 May 12 09:35:35.745304 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 173/329] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:35:35.840595 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-66090796-4166-4398-af1f-1b383be08f49 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:35.841460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-66090796-4166-4398-af1f-1b383be08f49 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:35.847604 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66090796-4166-4398-af1f-1b383be08f49 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:35.848003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66090796-4166-4398-af1f-1b383be08f49 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:35.848804 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66090796-4166-4398-af1f-1b383be08f49 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:35.849284 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66090796-4166-4398-af1f-1b383be08f49 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:35.982231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-66090796-4166-4398-af1f-1b383be08f49 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:35.990433 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-66090796-4166-4398-af1f-1b383be08f49 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.153568 May 12 09:35:35.991025 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 157/330] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:35 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:36.168992 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4b14de09-3d52-4c53-9008-73e454d00426 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:36.169686 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4b14de09-3d52-4c53-9008-73e454d00426 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:36.177610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4b14de09-3d52-4c53-9008-73e454d00426 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:36.178177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4b14de09-3d52-4c53-9008-73e454d00426 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:36.179171 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4b14de09-3d52-4c53-9008-73e454d00426 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:36.179830 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4b14de09-3d52-4c53-9008-73e454d00426 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:36.334104 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4b14de09-3d52-4c53-9008-73e454d00426 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:36.347068 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4b14de09-3d52-4c53-9008-73e454d00426 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.182397 May 12 09:35:36.347592 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 174/331] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:36 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:36.697490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-383ac2cd-2870-4d40-aa59-b86642208d00 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:36.698027 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-383ac2cd-2870-4d40-aa59-b86642208d00 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:36.719694 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-383ac2cd-2870-4d40-aa59-b86642208d00 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:36.721427 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-383ac2cd-2870-4d40-aa59-b86642208d00 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:36.722409 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-383ac2cd-2870-4d40-aa59-b86642208d00 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:36.723089 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-383ac2cd-2870-4d40-aa59-b86642208d00 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:36.822904 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-383ac2cd-2870-4d40-aa59-b86642208d00 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:36.842709 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-383ac2cd-2870-4d40-aa59-b86642208d00 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.169802 May 12 09:35:36.844191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 158/332] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:36 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:37.008560 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-93eac035-b347-4c21-867d-4d2249029f5a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:37.012510 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-93eac035-b347-4c21-867d-4d2249029f5a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:37.020334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-93eac035-b347-4c21-867d-4d2249029f5a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:37.021038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-93eac035-b347-4c21-867d-4d2249029f5a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:37.022706 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-93eac035-b347-4c21-867d-4d2249029f5a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:37.023308 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-93eac035-b347-4c21-867d-4d2249029f5a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:37.221299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-93eac035-b347-4c21-867d-4d2249029f5a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:37.229133 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-93eac035-b347-4c21-867d-4d2249029f5a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.224846 May 12 09:35:37.229879 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 175/333] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:37 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:37.364536 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-32b4972f-23c0-493f-bdef-5b93d2f7d82a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:37.365142 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-32b4972f-23c0-493f-bdef-5b93d2f7d82a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:37.371581 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-32b4972f-23c0-493f-bdef-5b93d2f7d82a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:37.372282 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-32b4972f-23c0-493f-bdef-5b93d2f7d82a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:37.373183 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-32b4972f-23c0-493f-bdef-5b93d2f7d82a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:37.373622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-32b4972f-23c0-493f-bdef-5b93d2f7d82a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:37.563873 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-32b4972f-23c0-493f-bdef-5b93d2f7d82a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:37.571808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-32b4972f-23c0-493f-bdef-5b93d2f7d82a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.211006 May 12 09:35:37.572310 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 159/334] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:37 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:37.860612 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c5616318-69e9-4aa8-a686-6ffa47d57cb2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:37.861215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c5616318-69e9-4aa8-a686-6ffa47d57cb2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:37.867655 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5616318-69e9-4aa8-a686-6ffa47d57cb2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:37.868097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5616318-69e9-4aa8-a686-6ffa47d57cb2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:37.868855 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5616318-69e9-4aa8-a686-6ffa47d57cb2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:37.869289 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5616318-69e9-4aa8-a686-6ffa47d57cb2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:37.945552 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c5616318-69e9-4aa8-a686-6ffa47d57cb2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:37.964582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c5616318-69e9-4aa8-a686-6ffa47d57cb2 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.107598 May 12 09:35:37.965391 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 176/335] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:37 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:38.246039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2f82e007-19de-477b-87f4-d8a46cf74312 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:38.254066 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2f82e007-19de-477b-87f4-d8a46cf74312 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:38.262694 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f82e007-19de-477b-87f4-d8a46cf74312 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:38.263419 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f82e007-19de-477b-87f4-d8a46cf74312 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:38.264199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f82e007-19de-477b-87f4-d8a46cf74312 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:38.264667 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f82e007-19de-477b-87f4-d8a46cf74312 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:38.445159 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2f82e007-19de-477b-87f4-d8a46cf74312 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:38.453574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2f82e007-19de-477b-87f4-d8a46cf74312 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.212086 May 12 09:35:38.454385 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 160/336] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:38 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:38.589369 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3db9c145-d62d-430e-b17f-d1a5deb81741 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:38.591470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3db9c145-d62d-430e-b17f-d1a5deb81741 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:38.598464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3db9c145-d62d-430e-b17f-d1a5deb81741 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:38.599882 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3db9c145-d62d-430e-b17f-d1a5deb81741 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:38.601252 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3db9c145-d62d-430e-b17f-d1a5deb81741 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:38.602067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3db9c145-d62d-430e-b17f-d1a5deb81741 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:38.781277 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3db9c145-d62d-430e-b17f-d1a5deb81741 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:38.790251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3db9c145-d62d-430e-b17f-d1a5deb81741 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.204868 May 12 09:35:38.800175 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 177/337] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:38 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:38.991979 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3e5670c7-8106-4786-8ee1-22bddacdf7e6 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:38.992703 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3e5670c7-8106-4786-8ee1-22bddacdf7e6 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:39.004886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3e5670c7-8106-4786-8ee1-22bddacdf7e6 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:39.005791 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3e5670c7-8106-4786-8ee1-22bddacdf7e6 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:39.006930 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3e5670c7-8106-4786-8ee1-22bddacdf7e6 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:39.007503 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3e5670c7-8106-4786-8ee1-22bddacdf7e6 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:39.087746 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-3e5670c7-8106-4786-8ee1-22bddacdf7e6 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:39.108364 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3e5670c7-8106-4786-8ee1-22bddacdf7e6 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.129539 May 12 09:35:39.109141 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 161/338] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:38 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:39.471223 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-941ef839-ace4-4e54-870f-b107759f5761 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:39.472238 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-941ef839-ace4-4e54-870f-b107759f5761 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:39.480934 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-941ef839-ace4-4e54-870f-b107759f5761 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:39.481474 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-941ef839-ace4-4e54-870f-b107759f5761 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:39.482389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-941ef839-ace4-4e54-870f-b107759f5761 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:39.482922 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-941ef839-ace4-4e54-870f-b107759f5761 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:39.637819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-941ef839-ace4-4e54-870f-b107759f5761 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:39.648497 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-941ef839-ace4-4e54-870f-b107759f5761 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.181700 May 12 09:35:39.649427 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 178/339] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:39 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:39.808502 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-fa6acec7-3f11-4435-90d6-f2ac0dfcd1fe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:39.809055 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-fa6acec7-3f11-4435-90d6-f2ac0dfcd1fe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:39.819261 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fa6acec7-3f11-4435-90d6-f2ac0dfcd1fe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:39.819802 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fa6acec7-3f11-4435-90d6-f2ac0dfcd1fe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:39.820579 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fa6acec7-3f11-4435-90d6-f2ac0dfcd1fe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:39.821211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fa6acec7-3f11-4435-90d6-f2ac0dfcd1fe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:39.958050 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-fa6acec7-3f11-4435-90d6-f2ac0dfcd1fe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:39.965424 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-fa6acec7-3f11-4435-90d6-f2ac0dfcd1fe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.160829 May 12 09:35:39.966952 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 162/340] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:39 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:40.128223 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-19c1bda4-1d2b-45b0-8587-d85ffeefdb38 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:40.129276 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-19c1bda4-1d2b-45b0-8587-d85ffeefdb38 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:40.139999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19c1bda4-1d2b-45b0-8587-d85ffeefdb38 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:40.140659 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19c1bda4-1d2b-45b0-8587-d85ffeefdb38 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:40.141647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19c1bda4-1d2b-45b0-8587-d85ffeefdb38 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:40.142489 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19c1bda4-1d2b-45b0-8587-d85ffeefdb38 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:40.233197 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-19c1bda4-1d2b-45b0-8587-d85ffeefdb38 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:40.241759 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-19c1bda4-1d2b-45b0-8587-d85ffeefdb38 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.118284 May 12 09:35:40.242366 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 179/341] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:40 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:40.666931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-77b87fe1-8516-4b9e-8c4a-88f11afaf17c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:40.667731 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-77b87fe1-8516-4b9e-8c4a-88f11afaf17c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:40.674129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-77b87fe1-8516-4b9e-8c4a-88f11afaf17c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:40.674682 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-77b87fe1-8516-4b9e-8c4a-88f11afaf17c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:40.676359 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-77b87fe1-8516-4b9e-8c4a-88f11afaf17c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:40.676859 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-77b87fe1-8516-4b9e-8c4a-88f11afaf17c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:40.813019 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-77b87fe1-8516-4b9e-8c4a-88f11afaf17c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:40.821611 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-77b87fe1-8516-4b9e-8c4a-88f11afaf17c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.158559 May 12 09:35:40.822219 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 163/342] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:40 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:40.982676 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e4663efb-cdbb-496b-af4c-73c41c1400cd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:40.983260 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e4663efb-cdbb-496b-af4c-73c41c1400cd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:40.990331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4663efb-cdbb-496b-af4c-73c41c1400cd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:40.991003 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4663efb-cdbb-496b-af4c-73c41c1400cd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:40.992098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4663efb-cdbb-496b-af4c-73c41c1400cd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:40.992840 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4663efb-cdbb-496b-af4c-73c41c1400cd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:41.124284 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e4663efb-cdbb-496b-af4c-73c41c1400cd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:41.132379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e4663efb-cdbb-496b-af4c-73c41c1400cd tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.153488 May 12 09:35:41.133273 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 180/343] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:40 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:41.259939 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9fe703cf-100a-46b0-9ce1-861cc9cbf266 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:41.260651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9fe703cf-100a-46b0-9ce1-861cc9cbf266 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:41.266930 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9fe703cf-100a-46b0-9ce1-861cc9cbf266 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:41.267471 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9fe703cf-100a-46b0-9ce1-861cc9cbf266 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:41.268308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9fe703cf-100a-46b0-9ce1-861cc9cbf266 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:41.268806 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9fe703cf-100a-46b0-9ce1-861cc9cbf266 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:41.330147 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9fe703cf-100a-46b0-9ce1-861cc9cbf266 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:41.337989 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9fe703cf-100a-46b0-9ce1-861cc9cbf266 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.083576 May 12 09:35:41.338537 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 164/344] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:41 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:41.838967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5534baeb-7acc-4007-a4ab-c6c4d8dde56a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:41.839877 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5534baeb-7acc-4007-a4ab-c6c4d8dde56a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:41.845871 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5534baeb-7acc-4007-a4ab-c6c4d8dde56a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:41.846288 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5534baeb-7acc-4007-a4ab-c6c4d8dde56a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:41.847038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5534baeb-7acc-4007-a4ab-c6c4d8dde56a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:41.847467 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5534baeb-7acc-4007-a4ab-c6c4d8dde56a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:41.974196 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5534baeb-7acc-4007-a4ab-c6c4d8dde56a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:41.981531 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5534baeb-7acc-4007-a4ab-c6c4d8dde56a tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.146371 May 12 09:35:41.982142 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 181/345] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:41 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:42.151327 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2b4d54ea-7938-4f69-b997-c2a3d62727b1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:42.151938 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2b4d54ea-7938-4f69-b997-c2a3d62727b1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:42.158141 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b4d54ea-7938-4f69-b997-c2a3d62727b1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:42.158589 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b4d54ea-7938-4f69-b997-c2a3d62727b1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:42.159430 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b4d54ea-7938-4f69-b997-c2a3d62727b1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:42.159899 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b4d54ea-7938-4f69-b997-c2a3d62727b1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:42.283363 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2b4d54ea-7938-4f69-b997-c2a3d62727b1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:42.291126 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2b4d54ea-7938-4f69-b997-c2a3d62727b1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.143784 May 12 09:35:42.291692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 165/346] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:42 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:42.355069 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-fbb43b10-1dca-4fa0-a9ee-c25605b66e94 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:42.355589 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-fbb43b10-1dca-4fa0-a9ee-c25605b66e94 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:42.361778 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fbb43b10-1dca-4fa0-a9ee-c25605b66e94 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:42.362261 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fbb43b10-1dca-4fa0-a9ee-c25605b66e94 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:42.363021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fbb43b10-1dca-4fa0-a9ee-c25605b66e94 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:42.363449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fbb43b10-1dca-4fa0-a9ee-c25605b66e94 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:42.423434 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-fbb43b10-1dca-4fa0-a9ee-c25605b66e94 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:42.431785 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-fbb43b10-1dca-4fa0-a9ee-c25605b66e94 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.080605 May 12 09:35:42.432357 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 182/347] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:42 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:42.998708 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-56b5374b-22ec-46d7-8a39-8ac3d3e1b5dd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:42.999341 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-56b5374b-22ec-46d7-8a39-8ac3d3e1b5dd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:43.005715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-56b5374b-22ec-46d7-8a39-8ac3d3e1b5dd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:43.006191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-56b5374b-22ec-46d7-8a39-8ac3d3e1b5dd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:43.006948 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-56b5374b-22ec-46d7-8a39-8ac3d3e1b5dd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:43.007382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-56b5374b-22ec-46d7-8a39-8ac3d3e1b5dd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:43.147212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-56b5374b-22ec-46d7-8a39-8ac3d3e1b5dd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:43.154628 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-56b5374b-22ec-46d7-8a39-8ac3d3e1b5dd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.159759 May 12 09:35:43.155221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 166/348] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:42 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:43.308463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-627f654d-def8-46dd-8f12-e1cd92a0d093 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:43.309058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-627f654d-def8-46dd-8f12-e1cd92a0d093 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:43.315005 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-627f654d-def8-46dd-8f12-e1cd92a0d093 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:43.315443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-627f654d-def8-46dd-8f12-e1cd92a0d093 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:43.316213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-627f654d-def8-46dd-8f12-e1cd92a0d093 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:43.316655 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-627f654d-def8-46dd-8f12-e1cd92a0d093 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:43.439227 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-627f654d-def8-46dd-8f12-e1cd92a0d093 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:43.446497 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-627f654d-def8-46dd-8f12-e1cd92a0d093 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.141958 May 12 09:35:43.447087 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 183/349] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:43 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:43.448455 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c865584b-1123-4743-8c16-851bbb812430 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:43.449046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c865584b-1123-4743-8c16-851bbb812430 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:43.454761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c865584b-1123-4743-8c16-851bbb812430 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:43.455209 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c865584b-1123-4743-8c16-851bbb812430 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:43.455960 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c865584b-1123-4743-8c16-851bbb812430 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:43.456387 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c865584b-1123-4743-8c16-851bbb812430 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:43.515045 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c865584b-1123-4743-8c16-851bbb812430 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:43.523167 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c865584b-1123-4743-8c16-851bbb812430 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.078571 May 12 09:35:43.523723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 167/350] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:43 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:44.171765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-977e4e9b-165f-4ebe-a989-8e1e0a529cd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:44.172381 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-977e4e9b-165f-4ebe-a989-8e1e0a529cd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:44.178862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-977e4e9b-165f-4ebe-a989-8e1e0a529cd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:44.179313 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-977e4e9b-165f-4ebe-a989-8e1e0a529cd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:44.180067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-977e4e9b-165f-4ebe-a989-8e1e0a529cd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:44.180513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-977e4e9b-165f-4ebe-a989-8e1e0a529cd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:44.304631 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-977e4e9b-165f-4ebe-a989-8e1e0a529cd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:44.311796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-977e4e9b-165f-4ebe-a989-8e1e0a529cd9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.144023 May 12 09:35:44.312357 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 184/351] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:44 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:44.462947 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c80a7e7b-ea68-4852-8d2e-ada0cfa8f46a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:44.463545 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c80a7e7b-ea68-4852-8d2e-ada0cfa8f46a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:44.469163 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c80a7e7b-ea68-4852-8d2e-ada0cfa8f46a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:44.469609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c80a7e7b-ea68-4852-8d2e-ada0cfa8f46a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:44.470398 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c80a7e7b-ea68-4852-8d2e-ada0cfa8f46a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:44.470829 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c80a7e7b-ea68-4852-8d2e-ada0cfa8f46a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:44.540285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-abbb5602-38ad-461d-97bf-aa3567b753bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:44.541000 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-abbb5602-38ad-461d-97bf-aa3567b753bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:44.547424 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-abbb5602-38ad-461d-97bf-aa3567b753bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:44.547875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-abbb5602-38ad-461d-97bf-aa3567b753bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:44.548677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-abbb5602-38ad-461d-97bf-aa3567b753bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:44.549114 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-abbb5602-38ad-461d-97bf-aa3567b753bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:44.603639 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c80a7e7b-ea68-4852-8d2e-ada0cfa8f46a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:44.610773 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c80a7e7b-ea68-4852-8d2e-ada0cfa8f46a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.151629 May 12 09:35:44.611338 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 168/352] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:44 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:44.618402 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-abbb5602-38ad-461d-97bf-aa3567b753bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:44.626071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-abbb5602-38ad-461d-97bf-aa3567b753bd tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.089669 May 12 09:35:44.626632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 185/353] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:44 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:45.328471 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d4f8191e-e0ec-4c53-a4f2-1d71e7791eb3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:45.329081 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d4f8191e-e0ec-4c53-a4f2-1d71e7791eb3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:45.335844 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4f8191e-e0ec-4c53-a4f2-1d71e7791eb3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:45.336301 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4f8191e-e0ec-4c53-a4f2-1d71e7791eb3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:45.337080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4f8191e-e0ec-4c53-a4f2-1d71e7791eb3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:45.337519 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4f8191e-e0ec-4c53-a4f2-1d71e7791eb3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:45.472343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d4f8191e-e0ec-4c53-a4f2-1d71e7791eb3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:45.480234 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d4f8191e-e0ec-4c53-a4f2-1d71e7791eb3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.155601 May 12 09:35:45.485631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 169/354] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:45 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:45.627648 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c07bf4f9-0f28-469e-a9d1-dd32fe6eabab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:45.628365 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c07bf4f9-0f28-469e-a9d1-dd32fe6eabab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:45.635040 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c07bf4f9-0f28-469e-a9d1-dd32fe6eabab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:45.635497 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c07bf4f9-0f28-469e-a9d1-dd32fe6eabab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:45.636276 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c07bf4f9-0f28-469e-a9d1-dd32fe6eabab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:45.636716 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c07bf4f9-0f28-469e-a9d1-dd32fe6eabab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:45.643623 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-582a25ce-2927-4f50-93db-718b494d579c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:45.644368 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-582a25ce-2927-4f50-93db-718b494d579c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:45.651546 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-582a25ce-2927-4f50-93db-718b494d579c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:45.652104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-582a25ce-2927-4f50-93db-718b494d579c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:45.653084 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-582a25ce-2927-4f50-93db-718b494d579c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:45.653709 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-582a25ce-2927-4f50-93db-718b494d579c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:45.732366 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-582a25ce-2927-4f50-93db-718b494d579c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:45.740276 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-582a25ce-2927-4f50-93db-718b494d579c tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.100522 May 12 09:35:45.741051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 170/355] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:45 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:45.805504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c07bf4f9-0f28-469e-a9d1-dd32fe6eabab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:45.813282 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c07bf4f9-0f28-469e-a9d1-dd32fe6eabab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.189524 May 12 09:35:45.813925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 186/356] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:45 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:46.496549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-11146fb8-3522-4682-bc94-64898157aaac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:46.497290 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-11146fb8-3522-4682-bc94-64898157aaac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:46.503151 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-11146fb8-3522-4682-bc94-64898157aaac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:46.503601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-11146fb8-3522-4682-bc94-64898157aaac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:46.504364 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-11146fb8-3522-4682-bc94-64898157aaac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:46.505383 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-11146fb8-3522-4682-bc94-64898157aaac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:46.657032 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-11146fb8-3522-4682-bc94-64898157aaac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:46.665066 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-11146fb8-3522-4682-bc94-64898157aaac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.172312 May 12 09:35:46.665731 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 171/357] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:46 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:46.757122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cbc4351e-7d58-4a2b-9dcf-59d94120ab1b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:46.759474 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cbc4351e-7d58-4a2b-9dcf-59d94120ab1b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:46.767104 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cbc4351e-7d58-4a2b-9dcf-59d94120ab1b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:46.767662 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cbc4351e-7d58-4a2b-9dcf-59d94120ab1b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:46.768538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cbc4351e-7d58-4a2b-9dcf-59d94120ab1b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:46.769200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cbc4351e-7d58-4a2b-9dcf-59d94120ab1b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:46.832701 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4b227b9d-b8f9-41b7-82ee-151e0f46a1f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:46.834546 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4b227b9d-b8f9-41b7-82ee-151e0f46a1f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:46.842396 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-cbc4351e-7d58-4a2b-9dcf-59d94120ab1b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:46.847312 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4b227b9d-b8f9-41b7-82ee-151e0f46a1f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:46.847813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4b227b9d-b8f9-41b7-82ee-151e0f46a1f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:46.849302 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4b227b9d-b8f9-41b7-82ee-151e0f46a1f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:46.849747 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4b227b9d-b8f9-41b7-82ee-151e0f46a1f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:46.851350 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cbc4351e-7d58-4a2b-9dcf-59d94120ab1b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.098440 May 12 09:35:46.852107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 187/358] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:46 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:46.993779 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4b227b9d-b8f9-41b7-82ee-151e0f46a1f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:47.001512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4b227b9d-b8f9-41b7-82ee-151e0f46a1f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.174479 May 12 09:35:47.002488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 172/359] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:46 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:47.681613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-72038e42-0053-48a5-a3bd-0c265e1d4192 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:47.682242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-72038e42-0053-48a5-a3bd-0c265e1d4192 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:47.688145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72038e42-0053-48a5-a3bd-0c265e1d4192 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:47.688588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72038e42-0053-48a5-a3bd-0c265e1d4192 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:47.689343 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72038e42-0053-48a5-a3bd-0c265e1d4192 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:47.689777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72038e42-0053-48a5-a3bd-0c265e1d4192 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:47.820895 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-72038e42-0053-48a5-a3bd-0c265e1d4192 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:47.828060 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-72038e42-0053-48a5-a3bd-0c265e1d4192 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.150232 May 12 09:35:47.828626 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 188/360] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:47 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:47.868581 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d06cb7b5-9310-404a-89ef-821fcff5007f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:47.869141 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d06cb7b5-9310-404a-89ef-821fcff5007f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:47.874903 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d06cb7b5-9310-404a-89ef-821fcff5007f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:47.875353 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d06cb7b5-9310-404a-89ef-821fcff5007f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:47.876114 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d06cb7b5-9310-404a-89ef-821fcff5007f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:47.876547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d06cb7b5-9310-404a-89ef-821fcff5007f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:47.935886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d06cb7b5-9310-404a-89ef-821fcff5007f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:47.943535 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d06cb7b5-9310-404a-89ef-821fcff5007f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.078840 May 12 09:35:47.944084 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 173/361] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:47 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:48.018764 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0fb77ce7-f094-4451-a112-d16342d55211 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:48.019376 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0fb77ce7-f094-4451-a112-d16342d55211 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:48.025218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0fb77ce7-f094-4451-a112-d16342d55211 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:48.025671 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0fb77ce7-f094-4451-a112-d16342d55211 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:48.026461 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0fb77ce7-f094-4451-a112-d16342d55211 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:48.026907 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0fb77ce7-f094-4451-a112-d16342d55211 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:48.153794 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-0fb77ce7-f094-4451-a112-d16342d55211 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:48.161488 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-0fb77ce7-f094-4451-a112-d16342d55211 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.146086 May 12 09:35:48.162080 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 189/362] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:48 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:48.845232 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4cd2a59e-b19f-4bbd-81e9-ab8626fc63cb tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:48.845831 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4cd2a59e-b19f-4bbd-81e9-ab8626fc63cb tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:48.851823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cd2a59e-b19f-4bbd-81e9-ab8626fc63cb tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:48.852268 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cd2a59e-b19f-4bbd-81e9-ab8626fc63cb tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:48.853020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cd2a59e-b19f-4bbd-81e9-ab8626fc63cb tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:48.853447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4cd2a59e-b19f-4bbd-81e9-ab8626fc63cb tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:48.960513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d2ac2b8b-5dc6-4c2c-922a-d44ac95f2737 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:48.961139 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d2ac2b8b-5dc6-4c2c-922a-d44ac95f2737 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:48.968037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d2ac2b8b-5dc6-4c2c-922a-d44ac95f2737 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:48.968707 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d2ac2b8b-5dc6-4c2c-922a-d44ac95f2737 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:48.969640 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d2ac2b8b-5dc6-4c2c-922a-d44ac95f2737 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:48.970104 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d2ac2b8b-5dc6-4c2c-922a-d44ac95f2737 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:48.978417 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4cd2a59e-b19f-4bbd-81e9-ab8626fc63cb tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:48.994337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4cd2a59e-b19f-4bbd-81e9-ab8626fc63cb tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.152870 May 12 09:35:48.994908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 174/363] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:48 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:49.034032 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d2ac2b8b-5dc6-4c2c-922a-d44ac95f2737 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:49.042600 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d2ac2b8b-5dc6-4c2c-922a-d44ac95f2737 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.086175 May 12 09:35:49.043160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 190/364] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:48 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:49.178343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-600c99fd-457f-4592-8c49-57015ca97fd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:49.178873 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-600c99fd-457f-4592-8c49-57015ca97fd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:49.184878 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-600c99fd-457f-4592-8c49-57015ca97fd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:49.185331 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-600c99fd-457f-4592-8c49-57015ca97fd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:49.186124 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-600c99fd-457f-4592-8c49-57015ca97fd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:49.186567 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-600c99fd-457f-4592-8c49-57015ca97fd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:49.311245 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-600c99fd-457f-4592-8c49-57015ca97fd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:49.318578 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-600c99fd-457f-4592-8c49-57015ca97fd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.144197 May 12 09:35:49.319139 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 175/365] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:49 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:50.010864 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0732cc55-ae52-4a23-aef4-4e2567b30164 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:50.011444 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0732cc55-ae52-4a23-aef4-4e2567b30164 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:50.017870 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0732cc55-ae52-4a23-aef4-4e2567b30164 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:50.018255 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0732cc55-ae52-4a23-aef4-4e2567b30164 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:50.019018 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0732cc55-ae52-4a23-aef4-4e2567b30164 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:50.019453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0732cc55-ae52-4a23-aef4-4e2567b30164 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:50.059226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-93acc4b0-ccfd-4471-84d1-8a7614113a67 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:50.059833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-93acc4b0-ccfd-4471-84d1-8a7614113a67 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:50.065570 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-93acc4b0-ccfd-4471-84d1-8a7614113a67 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:50.066043 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-93acc4b0-ccfd-4471-84d1-8a7614113a67 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:50.066800 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-93acc4b0-ccfd-4471-84d1-8a7614113a67 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:50.067252 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-93acc4b0-ccfd-4471-84d1-8a7614113a67 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:50.130344 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-93acc4b0-ccfd-4471-84d1-8a7614113a67 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:50.138585 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-93acc4b0-ccfd-4471-84d1-8a7614113a67 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1511 microversion: 2.1 time: 0.083073 May 12 09:35:50.139164 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 176/366] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:50 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1511 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:50.164434 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-0732cc55-ae52-4a23-aef4-4e2567b30164 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:50.171542 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-0732cc55-ae52-4a23-aef4-4e2567b30164 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.164745 May 12 09:35:50.172112 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 191/367] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:50 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:50.336099 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1a132d89-abc0-4937-abdc-144af2c318d6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:50.336630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1a132d89-abc0-4937-abdc-144af2c318d6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:50.342535 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1a132d89-abc0-4937-abdc-144af2c318d6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:50.343025 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1a132d89-abc0-4937-abdc-144af2c318d6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:50.343786 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1a132d89-abc0-4937-abdc-144af2c318d6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:50.344222 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1a132d89-abc0-4937-abdc-144af2c318d6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:50.471232 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1a132d89-abc0-4937-abdc-144af2c318d6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:50.478563 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1a132d89-abc0-4937-abdc-144af2c318d6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.147019 May 12 09:35:50.479128 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 177/368] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:50 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:51.162792 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-90e2e627-e0f3-4255-8705-664f6201838f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:51.163989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-90e2e627-e0f3-4255-8705-664f6201838f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:51.172027 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90e2e627-e0f3-4255-8705-664f6201838f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:51.172484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90e2e627-e0f3-4255-8705-664f6201838f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:51.173260 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90e2e627-e0f3-4255-8705-664f6201838f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:51.173696 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90e2e627-e0f3-4255-8705-664f6201838f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:51.188062 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-00bf343f-28e7-4be8-a425-2c3cb016a10d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:51.188815 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-00bf343f-28e7-4be8-a425-2c3cb016a10d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:51.196143 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00bf343f-28e7-4be8-a425-2c3cb016a10d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:51.196812 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00bf343f-28e7-4be8-a425-2c3cb016a10d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:51.197826 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00bf343f-28e7-4be8-a425-2c3cb016a10d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:51.198484 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00bf343f-28e7-4be8-a425-2c3cb016a10d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:51.250747 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-90e2e627-e0f3-4255-8705-664f6201838f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:51.260143 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-90e2e627-e0f3-4255-8705-664f6201838f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1345 microversion: 2.1 time: 0.108085 May 12 09:35:51.260717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 192/369] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:51 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:51.360057 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-00bf343f-28e7-4be8-a425-2c3cb016a10d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:51.367173 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-00bf343f-28e7-4be8-a425-2c3cb016a10d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.182936 May 12 09:35:51.367735 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 178/370] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:51 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:35:51.496400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c873672f-f28b-42a6-9a2a-0ea0078a14a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:51.497026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c873672f-f28b-42a6-9a2a-0ea0078a14a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:51.503112 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c873672f-f28b-42a6-9a2a-0ea0078a14a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:51.503611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c873672f-f28b-42a6-9a2a-0ea0078a14a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:51.504411 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c873672f-f28b-42a6-9a2a-0ea0078a14a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:51.505541 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c873672f-f28b-42a6-9a2a-0ea0078a14a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:51.639621 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c873672f-f28b-42a6-9a2a-0ea0078a14a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:51.647137 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c873672f-f28b-42a6-9a2a-0ea0078a14a6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.155412 May 12 09:35:51.647725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 193/371] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:51 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:52.277808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1e145fd8-0c63-43e4-9c8e-2043e196e61b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:52.279276 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1e145fd8-0c63-43e4-9c8e-2043e196e61b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:52.287724 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1e145fd8-0c63-43e4-9c8e-2043e196e61b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:52.288290 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1e145fd8-0c63-43e4-9c8e-2043e196e61b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:52.289158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1e145fd8-0c63-43e4-9c8e-2043e196e61b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:52.289874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1e145fd8-0c63-43e4-9c8e-2043e196e61b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:52.352543 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1e145fd8-0c63-43e4-9c8e-2043e196e61b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:52.360674 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1e145fd8-0c63-43e4-9c8e-2043e196e61b tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1345 microversion: 2.1 time: 0.087000 May 12 09:35:52.361286 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 179/372] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:52 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:52.383532 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1ed23df2-d288-4093-b7a9-60ef1aa8eec4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:52.384452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1ed23df2-d288-4093-b7a9-60ef1aa8eec4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:52.390811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ed23df2-d288-4093-b7a9-60ef1aa8eec4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:52.391268 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ed23df2-d288-4093-b7a9-60ef1aa8eec4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:52.392038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ed23df2-d288-4093-b7a9-60ef1aa8eec4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:52.392479 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ed23df2-d288-4093-b7a9-60ef1aa8eec4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:52.523770 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1ed23df2-d288-4093-b7a9-60ef1aa8eec4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:52.531244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1ed23df2-d288-4093-b7a9-60ef1aa8eec4 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.151537 May 12 09:35:52.531839 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 194/373] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:52 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:52.663939 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e9d47838-6bb6-477a-b1c6-a2f56775e6f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:52.664548 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e9d47838-6bb6-477a-b1c6-a2f56775e6f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:52.670663 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e9d47838-6bb6-477a-b1c6-a2f56775e6f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:52.671134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e9d47838-6bb6-477a-b1c6-a2f56775e6f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:52.671938 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e9d47838-6bb6-477a-b1c6-a2f56775e6f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:52.672418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e9d47838-6bb6-477a-b1c6-a2f56775e6f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:52.799533 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e9d47838-6bb6-477a-b1c6-a2f56775e6f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:52.807314 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e9d47838-6bb6-477a-b1c6-a2f56775e6f7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.147704 May 12 09:35:52.807877 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 180/374] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:52 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:53.378226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ead3f744-bd82-473a-bb39-bae4be0feba8 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:53.378753 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ead3f744-bd82-473a-bb39-bae4be0feba8 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:53.385528 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ead3f744-bd82-473a-bb39-bae4be0feba8 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:53.386120 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ead3f744-bd82-473a-bb39-bae4be0feba8 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:53.387112 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ead3f744-bd82-473a-bb39-bae4be0feba8 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:53.387705 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ead3f744-bd82-473a-bb39-bae4be0feba8 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:53.452573 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ead3f744-bd82-473a-bb39-bae4be0feba8 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:53.461006 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ead3f744-bd82-473a-bb39-bae4be0feba8 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1345 microversion: 2.1 time: 0.086770 May 12 09:35:53.461586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 195/375] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:53 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:53.547840 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-40ce7389-24c0-4f98-b331-d0530c3f837f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:53.548431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-40ce7389-24c0-4f98-b331-d0530c3f837f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:53.554900 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-40ce7389-24c0-4f98-b331-d0530c3f837f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:53.555342 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-40ce7389-24c0-4f98-b331-d0530c3f837f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:53.556096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-40ce7389-24c0-4f98-b331-d0530c3f837f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:53.556525 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-40ce7389-24c0-4f98-b331-d0530c3f837f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:53.678752 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-40ce7389-24c0-4f98-b331-d0530c3f837f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:53.686350 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-40ce7389-24c0-4f98-b331-d0530c3f837f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.142392 May 12 09:35:53.687008 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 181/376] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:53 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:53.824090 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5d177e90-7c07-4284-b0f7-186d7f89cd72 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:53.824699 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5d177e90-7c07-4284-b0f7-186d7f89cd72 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:53.830747 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5d177e90-7c07-4284-b0f7-186d7f89cd72 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:53.831194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5d177e90-7c07-4284-b0f7-186d7f89cd72 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:53.831949 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5d177e90-7c07-4284-b0f7-186d7f89cd72 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:53.832870 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5d177e90-7c07-4284-b0f7-186d7f89cd72 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:53.956333 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5d177e90-7c07-4284-b0f7-186d7f89cd72 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:53.964047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5d177e90-7c07-4284-b0f7-186d7f89cd72 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.143884 May 12 09:35:53.964604 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 196/377] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:53 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:54.477014 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-650d3f8a-e6fe-4a2b-a22a-9fba50229a92 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:54.477747 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-650d3f8a-e6fe-4a2b-a22a-9fba50229a92 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:54.484035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-650d3f8a-e6fe-4a2b-a22a-9fba50229a92 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:54.484483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-650d3f8a-e6fe-4a2b-a22a-9fba50229a92 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:54.485269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-650d3f8a-e6fe-4a2b-a22a-9fba50229a92 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:54.485705 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-650d3f8a-e6fe-4a2b-a22a-9fba50229a92 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:54.550163 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-650d3f8a-e6fe-4a2b-a22a-9fba50229a92 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:54.558350 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-650d3f8a-e6fe-4a2b-a22a-9fba50229a92 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1345 microversion: 2.1 time: 0.085289 May 12 09:35:54.558923 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 182/378] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:54 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:54.703218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-edd0ad27-42ba-4317-9383-55127414ca25 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:54.703835 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-edd0ad27-42ba-4317-9383-55127414ca25 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:54.711111 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-edd0ad27-42ba-4317-9383-55127414ca25 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:54.711559 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-edd0ad27-42ba-4317-9383-55127414ca25 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:54.712333 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-edd0ad27-42ba-4317-9383-55127414ca25 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:54.712769 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-edd0ad27-42ba-4317-9383-55127414ca25 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:54.837178 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-edd0ad27-42ba-4317-9383-55127414ca25 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:54.844559 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-edd0ad27-42ba-4317-9383-55127414ca25 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.145300 May 12 09:35:54.845148 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 197/379] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:54 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:54.980684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2673d3eb-6690-4fba-a8dd-a7d3028f6e25 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:54.981292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2673d3eb-6690-4fba-a8dd-a7d3028f6e25 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:54.987231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2673d3eb-6690-4fba-a8dd-a7d3028f6e25 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:54.987685 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2673d3eb-6690-4fba-a8dd-a7d3028f6e25 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:54.988452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2673d3eb-6690-4fba-a8dd-a7d3028f6e25 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:54.989454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2673d3eb-6690-4fba-a8dd-a7d3028f6e25 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:55.117281 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2673d3eb-6690-4fba-a8dd-a7d3028f6e25 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:55.124648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2673d3eb-6690-4fba-a8dd-a7d3028f6e25 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.147819 May 12 09:35:55.125212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 183/380] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:54 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:55.578289 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-72676dc3-6d1c-445a-852e-7d12de67a458 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:55.578887 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-72676dc3-6d1c-445a-852e-7d12de67a458 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:55.585684 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72676dc3-6d1c-445a-852e-7d12de67a458 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:55.586175 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72676dc3-6d1c-445a-852e-7d12de67a458 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:55.587146 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72676dc3-6d1c-445a-852e-7d12de67a458 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:55.587579 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72676dc3-6d1c-445a-852e-7d12de67a458 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:55.651430 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-72676dc3-6d1c-445a-852e-7d12de67a458 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:55.659275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-72676dc3-6d1c-445a-852e-7d12de67a458 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1345 microversion: 2.1 time: 0.084872 May 12 09:35:55.659830 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 198/381] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:55 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:55.860558 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a3cef224-fb84-4a0c-9992-95de716ea3c0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:55.861091 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a3cef224-fb84-4a0c-9992-95de716ea3c0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:55.867481 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a3cef224-fb84-4a0c-9992-95de716ea3c0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:55.867925 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a3cef224-fb84-4a0c-9992-95de716ea3c0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:55.868675 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a3cef224-fb84-4a0c-9992-95de716ea3c0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:55.869108 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a3cef224-fb84-4a0c-9992-95de716ea3c0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:55.995769 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a3cef224-fb84-4a0c-9992-95de716ea3c0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:56.003463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a3cef224-fb84-4a0c-9992-95de716ea3c0 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.146776 May 12 09:35:56.004400 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 184/382] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:55 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:56.142323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7ea23ddf-7079-4007-b5fc-e8f09d12e987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:56.142870 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7ea23ddf-7079-4007-b5fc-e8f09d12e987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:56.149344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ea23ddf-7079-4007-b5fc-e8f09d12e987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:56.149797 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ea23ddf-7079-4007-b5fc-e8f09d12e987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:56.150611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ea23ddf-7079-4007-b5fc-e8f09d12e987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:56.151044 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7ea23ddf-7079-4007-b5fc-e8f09d12e987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:56.275682 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7ea23ddf-7079-4007-b5fc-e8f09d12e987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:56.282982 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7ea23ddf-7079-4007-b5fc-e8f09d12e987 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.144620 May 12 09:35:56.283542 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 199/383] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:56 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:56.676698 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-02b985f0-1d12-452b-b371-60d25b4f4978 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:56.677213 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-02b985f0-1d12-452b-b371-60d25b4f4978 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:56.683101 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-02b985f0-1d12-452b-b371-60d25b4f4978 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:56.683664 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-02b985f0-1d12-452b-b371-60d25b4f4978 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:56.684315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-02b985f0-1d12-452b-b371-60d25b4f4978 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:56.684789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-02b985f0-1d12-452b-b371-60d25b4f4978 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:56.751723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-02b985f0-1d12-452b-b371-60d25b4f4978 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:56.759760 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-02b985f0-1d12-452b-b371-60d25b4f4978 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1345 microversion: 2.1 time: 0.087033 May 12 09:35:56.760422 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 185/384] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:56 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:57.021000 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f7a4511a-f4b7-427b-bb6e-fadf0d7a0aac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:57.021687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f7a4511a-f4b7-427b-bb6e-fadf0d7a0aac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:57.027515 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f7a4511a-f4b7-427b-bb6e-fadf0d7a0aac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:57.027962 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f7a4511a-f4b7-427b-bb6e-fadf0d7a0aac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:57.028722 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f7a4511a-f4b7-427b-bb6e-fadf0d7a0aac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:57.029160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f7a4511a-f4b7-427b-bb6e-fadf0d7a0aac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:57.154451 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f7a4511a-f4b7-427b-bb6e-fadf0d7a0aac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:57.162320 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f7a4511a-f4b7-427b-bb6e-fadf0d7a0aac tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.145765 May 12 09:35:57.162873 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 200/385] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:57 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:57.299446 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4740ed30-27da-409b-9086-c934e7740cee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:57.300010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4740ed30-27da-409b-9086-c934e7740cee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:57.306547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4740ed30-27da-409b-9086-c934e7740cee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:57.307010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4740ed30-27da-409b-9086-c934e7740cee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:57.307774 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4740ed30-27da-409b-9086-c934e7740cee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:57.308215 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4740ed30-27da-409b-9086-c934e7740cee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:57.433418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4740ed30-27da-409b-9086-c934e7740cee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:57.444006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4740ed30-27da-409b-9086-c934e7740cee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.148390 May 12 09:35:57.444616 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 186/386] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:57 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:57.776456 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-59adbc65-9ad3-401c-a43b-a79a0f322714 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:57.777061 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-59adbc65-9ad3-401c-a43b-a79a0f322714 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:57.783002 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59adbc65-9ad3-401c-a43b-a79a0f322714 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:57.783452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59adbc65-9ad3-401c-a43b-a79a0f322714 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:57.784212 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59adbc65-9ad3-401c-a43b-a79a0f322714 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:57.784649 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59adbc65-9ad3-401c-a43b-a79a0f322714 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:57.846623 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-59adbc65-9ad3-401c-a43b-a79a0f322714 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:57.854389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-59adbc65-9ad3-401c-a43b-a79a0f322714 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1345 microversion: 2.1 time: 0.081811 May 12 09:35:57.854948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 201/387] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:57 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:58.179457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-dceaacd7-c208-445b-aef3-4b485eb7dbcd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:58.180237 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-dceaacd7-c208-445b-aef3-4b485eb7dbcd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:58.185927 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dceaacd7-c208-445b-aef3-4b485eb7dbcd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:58.186389 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dceaacd7-c208-445b-aef3-4b485eb7dbcd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:58.187142 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dceaacd7-c208-445b-aef3-4b485eb7dbcd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:58.187573 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dceaacd7-c208-445b-aef3-4b485eb7dbcd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:58.309905 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-dceaacd7-c208-445b-aef3-4b485eb7dbcd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:58.317150 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-dceaacd7-c208-445b-aef3-4b485eb7dbcd tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.142097 May 12 09:35:58.317648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 187/388] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:58 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:58.460526 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6fa02fb6-3b6d-44e8-84bb-588c9eba9866 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:58.461165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6fa02fb6-3b6d-44e8-84bb-588c9eba9866 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:58.467545 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6fa02fb6-3b6d-44e8-84bb-588c9eba9866 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:58.467992 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6fa02fb6-3b6d-44e8-84bb-588c9eba9866 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:58.468754 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6fa02fb6-3b6d-44e8-84bb-588c9eba9866 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:58.469188 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6fa02fb6-3b6d-44e8-84bb-588c9eba9866 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:58.596158 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6fa02fb6-3b6d-44e8-84bb-588c9eba9866 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:58.603492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6fa02fb6-3b6d-44e8-84bb-588c9eba9866 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.146830 May 12 09:35:58.610530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 202/389] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:58 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:58.870803 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-caaa087e-392e-4f19-b300-06bda5633dbf tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:58.871412 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-caaa087e-392e-4f19-b300-06bda5633dbf tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:58.877116 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-caaa087e-392e-4f19-b300-06bda5633dbf tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:58.877563 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-caaa087e-392e-4f19-b300-06bda5633dbf tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:58.878347 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-caaa087e-392e-4f19-b300-06bda5633dbf tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:58.878779 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-caaa087e-392e-4f19-b300-06bda5633dbf tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:58.939825 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-caaa087e-392e-4f19-b300-06bda5633dbf tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:58.947886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-caaa087e-392e-4f19-b300-06bda5633dbf tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1345 microversion: 2.1 time: 0.080807 May 12 09:35:58.948463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 188/390] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:58 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:59.334549 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-59473cd7-dcf5-4f89-9b80-b2a32ebabade tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:59.335166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-59473cd7-dcf5-4f89-9b80-b2a32ebabade tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:59.340913 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59473cd7-dcf5-4f89-9b80-b2a32ebabade tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:59.341372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59473cd7-dcf5-4f89-9b80-b2a32ebabade tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:59.342244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59473cd7-dcf5-4f89-9b80-b2a32ebabade tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:59.342691 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-59473cd7-dcf5-4f89-9b80-b2a32ebabade tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:59.469008 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-59473cd7-dcf5-4f89-9b80-b2a32ebabade tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:59.476681 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-59473cd7-dcf5-4f89-9b80-b2a32ebabade tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.146128 May 12 09:35:59.477245 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 203/391] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:59 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:59.620675 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1ce15fe4-46a7-4f96-a1d6-8a9b38747f6e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:59.621191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1ce15fe4-46a7-4f96-a1d6-8a9b38747f6e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:59.627023 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ce15fe4-46a7-4f96-a1d6-8a9b38747f6e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:59.627480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ce15fe4-46a7-4f96-a1d6-8a9b38747f6e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:59.628562 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ce15fe4-46a7-4f96-a1d6-8a9b38747f6e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:59.628664 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ce15fe4-46a7-4f96-a1d6-8a9b38747f6e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:59.755630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1ce15fe4-46a7-4f96-a1d6-8a9b38747f6e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:35:59.763168 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1ce15fe4-46a7-4f96-a1d6-8a9b38747f6e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.146413 May 12 09:35:59.763731 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 189/392] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:59 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:35:59.965719 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-12434fa1-49b3-4b70-bb6e-f2c74583837e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:35:59.966516 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-12434fa1-49b3-4b70-bb6e-f2c74583837e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:35:59.972732 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-12434fa1-49b3-4b70-bb6e-f2c74583837e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:59.973141 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-12434fa1-49b3-4b70-bb6e-f2c74583837e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:35:59.973910 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-12434fa1-49b3-4b70-bb6e-f2c74583837e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:35:59.974347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-12434fa1-49b3-4b70-bb6e-f2c74583837e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:00.038264 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-12434fa1-49b3-4b70-bb6e-f2c74583837e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded41aae383242789d1e468372767efb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2de1508e265140e5801827175c7da941', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:00.045945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-12434fa1-49b3-4b70-bb6e-f2c74583837e tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 200 len: 1345 microversion: 2.1 time: 0.084038 May 12 09:36:00.046506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 204/393] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:35:59 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:00.492920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-67b98bc6-c0dc-4010-88b6-92293985d4c7 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:00.493556 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-67b98bc6-c0dc-4010-88b6-92293985d4c7 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:00.499572 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67b98bc6-c0dc-4010-88b6-92293985d4c7 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:00.500016 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67b98bc6-c0dc-4010-88b6-92293985d4c7 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:00.500768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67b98bc6-c0dc-4010-88b6-92293985d4c7 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:00.501195 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67b98bc6-c0dc-4010-88b6-92293985d4c7 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:00.623710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-67b98bc6-c0dc-4010-88b6-92293985d4c7 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:00.632165 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-67b98bc6-c0dc-4010-88b6-92293985d4c7 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.143445 May 12 09:36:00.632904 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 190/394] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:00 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:00.780949 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-84ae216d-06e8-42c2-b8d3-b3c4d769dcdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:00.781520 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-84ae216d-06e8-42c2-b8d3-b3c4d769dcdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:00.788084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-84ae216d-06e8-42c2-b8d3-b3c4d769dcdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:00.788538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-84ae216d-06e8-42c2-b8d3-b3c4d769dcdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:00.789309 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-84ae216d-06e8-42c2-b8d3-b3c4d769dcdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:00.789743 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-84ae216d-06e8-42c2-b8d3-b3c4d769dcdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:00.815294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-1ea86c96-f21c-4b63-9c6c-afb6166ec2d2 req-34e1fbc2-6250-4e50-a2b3-6bb101a57e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a158cc80-2631-4dba-8071-ef5e07ec8ba1", "name": "network-vif-plugged", "status": "completed", "tag": "3af65aa8-83b2-410d-b24d-4b9b1b6dd549"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:36:00.823641 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-1ea86c96-f21c-4b63-9c6c-afb6166ec2d2 req-34e1fbc2-6250-4e50-a2b3-6bb101a57e6c service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:00.824086 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-1ea86c96-f21c-4b63-9c6c-afb6166ec2d2 req-34e1fbc2-6250-4e50-a2b3-6bb101a57e6c service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:00.839646 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-1ea86c96-f21c-4b63-9c6c-afb6166ec2d2 req-34e1fbc2-6250-4e50-a2b3-6bb101a57e6c service nova] Creating event network-vif-plugged:3af65aa8-83b2-410d-b24d-4b9b1b6dd549 for instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 on hv-cinder-83769 May 12 09:36:00.845152 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-1ea86c96-f21c-4b63-9c6c-afb6166ec2d2 req-34e1fbc2-6250-4e50-a2b3-6bb101a57e6c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033721 May 12 09:36:00.846174 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 191/395] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:36:00.923309 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-84ae216d-06e8-42c2-b8d3-b3c4d769dcdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:00.932040 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-84ae216d-06e8-42c2-b8d3-b3c4d769dcdc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.155267 May 12 09:36:00.932677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 205/396] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:00 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:36:01.065045 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:01.065746 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:01.073418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:01.073872 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:01.074704 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:01.075143 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:01.091011 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] HTTP exception thrown: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Request method failure captured: May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 HTTP/1.1 May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR7TDUke80OXlflBdm6xOLIx6mTLqn4SlJzPH-5ltaDOcKxlnJ59z7k_ub80lokYt-gCMfB0-ra7UgDYEMjwU96ZiI1fxzjN6ZYvwr03W959nVZdanUfDLX9M-Elsb5oDGJrmvCsr6H62ePKH7AYGBoI8iORdtEirOU8_ueM5tS1oc May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: 2de1508e265140e5801827175c7da941 May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:36:01.106224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2de1508e265140e5801827175c7da941", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2de1508e265140e5801827175c7da941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2de1508e265140e5801827175c7da941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2de1508e265140e5801827175c7da941"}]}] May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: 2de1508e265140e5801827175c7da941 May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-DeleteServersTestJSON-1504060446-project May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: ded41aae383242789d1e468372767efb May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-DeleteServersTestJSON-1504060446-project May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.107820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'b658c976-df06-49bb-9c2d-4d42cead8156'} May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:36:01.108805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.110426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:01.112592 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Returning 404 to user: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:36:01.113563 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5f15bcd7-eecf-4e11-84e4-db440b5aa13f tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 404 len: 111 microversion: 2.1 time: 0.054001 May 12 09:36:01.114382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 192/397] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:01 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:36:01.223132 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:01.224837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:01.234749 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:01.235204 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:01.235985 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:01.236420 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:01.251430 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] HTTP exception thrown: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Request method failure captured: May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156/os-volume_attachments HTTP/1.1 May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR7TDUke80OXlflBdm6xOLIx6mTLqn4SlJzPH-5ltaDOcKxlnJ59z7k_ub80lokYt-gCMfB0-ra7UgDYEMjwU96ZiI1fxzjN6ZYvwr03W959nVZdanUfDLX9M-Elsb5oDGJrmvCsr6H62ePKH7AYGBoI8iORdtEirOU8_ueM5tS1oc May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: 2de1508e265140e5801827175c7da941 May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:36:01.256582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2de1508e265140e5801827175c7da941", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2de1508e265140e5801827175c7da941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2de1508e265140e5801827175c7da941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2de1508e265140e5801827175c7da941"}]}] May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: 2de1508e265140e5801827175c7da941 May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-DeleteServersTestJSON-1504060446-project May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: ded41aae383242789d1e468372767efb May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-DeleteServersTestJSON-1504060446-project May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.257966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'server_id': 'b658c976-df06-49bb-9c2d-4d42cead8156'} May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:36:01.258757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:01.260335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:01.261658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Returning 404 to user: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:36:01.261658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b42cda17-5bd8-4758-8cab-9fa2ad51cf46 tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040077 May 12 09:36:01.261658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 206/398] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:36:01 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:36:01.651508 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6cce821d-cf51-4f04-8027-8377b8499595 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:01.652069 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6cce821d-cf51-4f04-8027-8377b8499595 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:01.658033 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6cce821d-cf51-4f04-8027-8377b8499595 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:01.658536 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6cce821d-cf51-4f04-8027-8377b8499595 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:01.659337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6cce821d-cf51-4f04-8027-8377b8499595 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:01.659815 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6cce821d-cf51-4f04-8027-8377b8499595 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:01.785690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6cce821d-cf51-4f04-8027-8377b8499595 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:01.792858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6cce821d-cf51-4f04-8027-8377b8499595 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.145939 May 12 09:36:01.793425 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 193/399] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:01 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:36:01.948368 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-39223a69-b424-4cac-9a73-4b4712f0d957 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:01.949001 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-39223a69-b424-4cac-9a73-4b4712f0d957 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:01.955169 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39223a69-b424-4cac-9a73-4b4712f0d957 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:01.955607 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39223a69-b424-4cac-9a73-4b4712f0d957 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:01.956359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39223a69-b424-4cac-9a73-4b4712f0d957 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:01.956787 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39223a69-b424-4cac-9a73-4b4712f0d957 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:02.087033 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-39223a69-b424-4cac-9a73-4b4712f0d957 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:02.098536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-39223a69-b424-4cac-9a73-4b4712f0d957 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.149797 May 12 09:36:02.098536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 207/400] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:01 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:02.809705 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6030667f-6c4d-4aef-b9da-8671fac01051 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:02.810355 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6030667f-6c4d-4aef-b9da-8671fac01051 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:02.816155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6030667f-6c4d-4aef-b9da-8671fac01051 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:02.816636 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6030667f-6c4d-4aef-b9da-8671fac01051 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:02.817409 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6030667f-6c4d-4aef-b9da-8671fac01051 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:02.817847 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6030667f-6c4d-4aef-b9da-8671fac01051 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:03.001961 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6030667f-6c4d-4aef-b9da-8671fac01051 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:03.009670 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6030667f-6c4d-4aef-b9da-8671fac01051 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1357 microversion: 2.1 time: 0.203652 May 12 09:36:03.010556 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 194/401] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:02 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:03.111029 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ddab9c66-aba1-40e7-95be-6506c8214e9b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:03.111687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ddab9c66-aba1-40e7-95be-6506c8214e9b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:03.118919 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ddab9c66-aba1-40e7-95be-6506c8214e9b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:03.119364 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ddab9c66-aba1-40e7-95be-6506c8214e9b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:03.120127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ddab9c66-aba1-40e7-95be-6506c8214e9b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:03.120557 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ddab9c66-aba1-40e7-95be-6506c8214e9b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:03.253158 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ddab9c66-aba1-40e7-95be-6506c8214e9b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:03.263267 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ddab9c66-aba1-40e7-95be-6506c8214e9b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.156158 May 12 09:36:03.263846 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 208/402] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:03 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:03.515979 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:03.516786 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:03.524067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:03.524534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:03.525311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:03.526026 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:03.540631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] HTTP exception thrown: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Request method failure captured: May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: DELETE /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 HTTP/1.1 May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR7TDUke80OXlflBdm6xOLIx6mTLqn4SlJzPH-5ltaDOcKxlnJ59z7k_ub80lokYt-gCMfB0-ra7UgDYEMjwU96ZiI1fxzjN6ZYvwr03W959nVZdanUfDLX9M-Elsb5oDGJrmvCsr6H62ePKH7AYGBoI8iORdtEirOU8_ueM5tS1oc May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: 2de1508e265140e5801827175c7da941 May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:36:03.542071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2de1508e265140e5801827175c7da941", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2de1508e265140e5801827175c7da941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2de1508e265140e5801827175c7da941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2de1508e265140e5801827175c7da941"}]}] May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: 2de1508e265140e5801827175c7da941 May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-DeleteServersTestJSON-1504060446-project May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: ded41aae383242789d1e468372767efb May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-DeleteServersTestJSON-1504060446-project May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.543515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'b658c976-df06-49bb-9c2d-4d42cead8156'} May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:36:03.544321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.545538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:36:03.546698 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Returning 404 to user: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:36:03.546698 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-155dc1f9-d1ae-4f81-a089-61b3876ec2df tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 404 len: 111 microversion: 2.1 time: 0.031936 May 12 09:36:03.546698 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 195/403] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:36:03 2022] DELETE /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:36:03.551866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:03.552466 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] [instance: b658c976-df06-49bb-9c2d-4d42cead8156] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:03.558278 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:03.558921 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:03.559868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:03.560305 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:03.575091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] HTTP exception thrown: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Request method failure captured: May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 HTTP/1.1 May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR7TDUke80OXlflBdm6xOLIx6mTLqn4SlJzPH-5ltaDOcKxlnJ59z7k_ub80lokYt-gCMfB0-ra7UgDYEMjwU96ZiI1fxzjN6ZYvwr03W959nVZdanUfDLX9M-Elsb5oDGJrmvCsr6H62ePKH7AYGBoI8iORdtEirOU8_ueM5tS1oc May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: 2de1508e265140e5801827175c7da941 May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:36:03.577359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2de1508e265140e5801827175c7da941", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2de1508e265140e5801827175c7da941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2de1508e265140e5801827175c7da941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2de1508e265140e5801827175c7da941"}]}] May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: 2de1508e265140e5801827175c7da941 May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-DeleteServersTestJSON-1504060446 May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-DeleteServersTestJSON-1504060446-project May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: ded41aae383242789d1e468372767efb May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-DeleteServersTestJSON-1504060446-project May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.578897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'b658c976-df06-49bb-9c2d-4d42cead8156'} May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:36:03.579834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. May 12 09:36:03.581200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:36:03.586513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] Returning 404 to user: Instance b658c976-df06-49bb-9c2d-4d42cead8156 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:36:03.586513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-150e2cdf-2de2-444b-9dfc-6a38a9fd558a tempest-DeleteServersTestJSON-1504060446 tempest-DeleteServersTestJSON-1504060446-project] 10.222.0.60 "GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156" status: 404 len: 111 microversion: 2.1 time: 0.032150 May 12 09:36:03.586513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 209/404] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:03 2022] GET /compute/v2.1/servers/b658c976-df06-49bb-9c2d-4d42cead8156 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 09:36:04.026799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c21d3448-2ac6-4db3-b3b5-29320b19cb8f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:04.028221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c21d3448-2ac6-4db3-b3b5-29320b19cb8f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:04.034742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c21d3448-2ac6-4db3-b3b5-29320b19cb8f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:04.035719 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c21d3448-2ac6-4db3-b3b5-29320b19cb8f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:04.036723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c21d3448-2ac6-4db3-b3b5-29320b19cb8f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:04.037385 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c21d3448-2ac6-4db3-b3b5-29320b19cb8f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:04.284235 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ac693293-dbd8-4a64-8ff7-11845b4a9656 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:04.284843 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ac693293-dbd8-4a64-8ff7-11845b4a9656 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:04.291518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ac693293-dbd8-4a64-8ff7-11845b4a9656 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:04.291974 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ac693293-dbd8-4a64-8ff7-11845b4a9656 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:04.292875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ac693293-dbd8-4a64-8ff7-11845b4a9656 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:04.293349 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ac693293-dbd8-4a64-8ff7-11845b4a9656 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:04.293987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c21d3448-2ac6-4db3-b3b5-29320b19cb8f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:04.306326 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c21d3448-2ac6-4db3-b3b5-29320b19cb8f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1547 microversion: 2.1 time: 0.283804 May 12 09:36:04.306900 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 196/405] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:04 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1547 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:36:04.323955 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-544e8040-7818-433d-9626-f27f762d7573 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:04.324641 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-544e8040-7818-433d-9626-f27f762d7573 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:04.330630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-544e8040-7818-433d-9626-f27f762d7573 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:04.331080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-544e8040-7818-433d-9626-f27f762d7573 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:04.332049 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-544e8040-7818-433d-9626-f27f762d7573 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:04.332500 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-544e8040-7818-433d-9626-f27f762d7573 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:04.734264 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ac693293-dbd8-4a64-8ff7-11845b4a9656 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:04.744437 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ac693293-dbd8-4a64-8ff7-11845b4a9656 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.463737 May 12 09:36:04.745443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 210/406] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:04 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:36:04.756255 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-544e8040-7818-433d-9626-f27f762d7573 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:04.764327 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-544e8040-7818-433d-9626-f27f762d7573 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1547 microversion: 2.1 time: 0.444061 May 12 09:36:04.764893 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 197/407] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:04 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1547 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:36:04.780127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9473dece-e350-421e-adf7-c4bd967af388 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:04.784833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9473dece-e350-421e-adf7-c4bd967af388 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:04.785866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9473dece-e350-421e-adf7-c4bd967af388 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Searching by: {'deleted': False, 'project_id': 'bdc48145acde413e99299f029ad0cea9'} {{(pid=123510) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 12 09:36:04.792567 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9473dece-e350-421e-adf7-c4bd967af388 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:04.793249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9473dece-e350-421e-adf7-c4bd967af388 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:04.794238 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9473dece-e350-421e-adf7-c4bd967af388 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:04.794679 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9473dece-e350-421e-adf7-c4bd967af388 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:04.891984 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.multi_cell_list [None req-9473dece-e350-421e-adf7-c4bd967af388 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123510) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 12 09:36:05.017555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9473dece-e350-421e-adf7-c4bd967af388 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.241103 May 12 09:36:05.018195 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 211/408] 10.222.0.60 () {58 vars in 1124 bytes} [Thu May 12 09:36:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:36:05.032523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-84a44736-ba5b-42f7-91ce-dce6ff0e31c5 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:05.033933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-84a44736-ba5b-42f7-91ce-dce6ff0e31c5 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:05.040087 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-84a44736-ba5b-42f7-91ce-dce6ff0e31c5 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:05.040590 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-84a44736-ba5b-42f7-91ce-dce6ff0e31c5 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:05.041360 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-84a44736-ba5b-42f7-91ce-dce6ff0e31c5 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:05.041831 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-84a44736-ba5b-42f7-91ce-dce6ff0e31c5 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:05.219119 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-84a44736-ba5b-42f7-91ce-dce6ff0e31c5 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:05.226338 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-84a44736-ba5b-42f7-91ce-dce6ff0e31c5 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1547 microversion: 2.1 time: 0.198063 May 12 09:36:05.227223 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 198/409] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:05 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1547 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:36:05.762372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1eb52c0c-4ebc-48aa-a9fe-34d1f2d3f531 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:05.762987 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1eb52c0c-4ebc-48aa-a9fe-34d1f2d3f531 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:05.769124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1eb52c0c-4ebc-48aa-a9fe-34d1f2d3f531 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:05.769611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1eb52c0c-4ebc-48aa-a9fe-34d1f2d3f531 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:05.770401 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1eb52c0c-4ebc-48aa-a9fe-34d1f2d3f531 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:05.770834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1eb52c0c-4ebc-48aa-a9fe-34d1f2d3f531 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:05.905422 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1eb52c0c-4ebc-48aa-a9fe-34d1f2d3f531 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:05.912687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1eb52c0c-4ebc-48aa-a9fe-34d1f2d3f531 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.154531 May 12 09:36:05.913246 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 212/410] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:05 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:06.930003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2ca9ac7c-a5a5-488d-8e6d-a79d3b3fa82e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:06.930593 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2ca9ac7c-a5a5-488d-8e6d-a79d3b3fa82e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:06.939642 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ca9ac7c-a5a5-488d-8e6d-a79d3b3fa82e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:06.939642 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ca9ac7c-a5a5-488d-8e6d-a79d3b3fa82e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:06.939642 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ca9ac7c-a5a5-488d-8e6d-a79d3b3fa82e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:06.939642 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ca9ac7c-a5a5-488d-8e6d-a79d3b3fa82e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:07.066953 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2ca9ac7c-a5a5-488d-8e6d-a79d3b3fa82e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:07.074662 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2ca9ac7c-a5a5-488d-8e6d-a79d3b3fa82e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.149265 May 12 09:36:07.075450 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 199/411] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:06 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:08.091714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-61831d98-ef13-490e-824e-28b0f9018f17 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:08.092232 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-61831d98-ef13-490e-824e-28b0f9018f17 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:08.099024 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61831d98-ef13-490e-824e-28b0f9018f17 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:08.099803 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61831d98-ef13-490e-824e-28b0f9018f17 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:08.100571 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61831d98-ef13-490e-824e-28b0f9018f17 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:08.101008 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-61831d98-ef13-490e-824e-28b0f9018f17 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:08.230328 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-61831d98-ef13-490e-824e-28b0f9018f17 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:08.237483 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-61831d98-ef13-490e-824e-28b0f9018f17 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.149725 May 12 09:36:08.238081 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 213/412] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:08 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:09.255376 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-28f1bc22-afda-453e-846f-106c02c257ea tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:09.256146 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-28f1bc22-afda-453e-846f-106c02c257ea tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:09.262367 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-28f1bc22-afda-453e-846f-106c02c257ea tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:09.262819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-28f1bc22-afda-453e-846f-106c02c257ea tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:09.263586 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-28f1bc22-afda-453e-846f-106c02c257ea tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:09.264025 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-28f1bc22-afda-453e-846f-106c02c257ea tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:09.399996 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-28f1bc22-afda-453e-846f-106c02c257ea tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:09.407234 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-28f1bc22-afda-453e-846f-106c02c257ea tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.156212 May 12 09:36:09.407799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 200/413] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:09 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:10.424367 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-18e7f464-2424-4ed7-b108-974ea1267ac4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:10.424885 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-18e7f464-2424-4ed7-b108-974ea1267ac4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:10.430888 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-18e7f464-2424-4ed7-b108-974ea1267ac4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:10.431333 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-18e7f464-2424-4ed7-b108-974ea1267ac4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:10.432084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-18e7f464-2424-4ed7-b108-974ea1267ac4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:10.432516 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-18e7f464-2424-4ed7-b108-974ea1267ac4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:10.556792 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-18e7f464-2424-4ed7-b108-974ea1267ac4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:10.563924 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-18e7f464-2424-4ed7-b108-974ea1267ac4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.143404 May 12 09:36:10.564486 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 214/414] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:10 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:11.580909 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ea7af44d-6259-49d5-a535-2ad02e787fe8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:11.581455 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ea7af44d-6259-49d5-a535-2ad02e787fe8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:11.587973 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ea7af44d-6259-49d5-a535-2ad02e787fe8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:11.588412 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ea7af44d-6259-49d5-a535-2ad02e787fe8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:11.589160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ea7af44d-6259-49d5-a535-2ad02e787fe8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:11.589588 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ea7af44d-6259-49d5-a535-2ad02e787fe8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:11.713574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ea7af44d-6259-49d5-a535-2ad02e787fe8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:11.720831 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ea7af44d-6259-49d5-a535-2ad02e787fe8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.143938 May 12 09:36:11.721404 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 201/415] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:11 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:12.738080 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-86209047-44d7-4512-9f14-1ce7d032aba1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:12.738687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-86209047-44d7-4512-9f14-1ce7d032aba1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:12.745082 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86209047-44d7-4512-9f14-1ce7d032aba1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:12.745535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86209047-44d7-4512-9f14-1ce7d032aba1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:12.746319 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86209047-44d7-4512-9f14-1ce7d032aba1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:12.746749 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86209047-44d7-4512-9f14-1ce7d032aba1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:12.875052 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-86209047-44d7-4512-9f14-1ce7d032aba1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:12.882723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-86209047-44d7-4512-9f14-1ce7d032aba1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.148549 May 12 09:36:12.883274 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 215/416] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:12 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:13.900563 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0a4a0311-de8b-4424-8ee5-0ba755018ea0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:13.901991 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0a4a0311-de8b-4424-8ee5-0ba755018ea0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:13.909264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0a4a0311-de8b-4424-8ee5-0ba755018ea0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:13.909791 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0a4a0311-de8b-4424-8ee5-0ba755018ea0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:13.911174 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0a4a0311-de8b-4424-8ee5-0ba755018ea0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:13.911900 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0a4a0311-de8b-4424-8ee5-0ba755018ea0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:14.079339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0a4a0311-de8b-4424-8ee5-0ba755018ea0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:14.087043 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0a4a0311-de8b-4424-8ee5-0ba755018ea0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.191134 May 12 09:36:14.087738 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 202/417] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:13 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:15.117411 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-76c96e8b-027c-431b-a27a-25f5e949116e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:15.118057 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-76c96e8b-027c-431b-a27a-25f5e949116e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:15.124584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-76c96e8b-027c-431b-a27a-25f5e949116e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:15.125033 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-76c96e8b-027c-431b-a27a-25f5e949116e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:15.126064 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-76c96e8b-027c-431b-a27a-25f5e949116e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:15.126448 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-76c96e8b-027c-431b-a27a-25f5e949116e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:15.172652 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-16255d95-1aab-46c2-a34a-b912ceb05f4d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d79999b1-fead-48b7-a108-9f6e6299db32"}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:36:15.173728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-16255d95-1aab-46c2-a34a-b912ceb05f4d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:15.180959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-16255d95-1aab-46c2-a34a-b912ceb05f4d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:15.181720 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-16255d95-1aab-46c2-a34a-b912ceb05f4d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:15.185085 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-16255d95-1aab-46c2-a34a-b912ceb05f4d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:15.185824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-16255d95-1aab-46c2-a34a-b912ceb05f4d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:15.278539 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-76c96e8b-027c-431b-a27a-25f5e949116e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:15.292409 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-76c96e8b-027c-431b-a27a-25f5e949116e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.181350 May 12 09:36:15.292993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 216/418] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:15 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:15.535776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-16255d95-1aab-46c2-a34a-b912ceb05f4d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "POST /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365900 May 12 09:36:15.536651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 203/419] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:36:15 2022] POST /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:36:16.308344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-40b48902-eff0-4169-b73e-246b8e1f34ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:16.309017 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-40b48902-eff0-4169-b73e-246b8e1f34ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:16.315572 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-40b48902-eff0-4169-b73e-246b8e1f34ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:16.316018 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-40b48902-eff0-4169-b73e-246b8e1f34ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:16.316860 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-40b48902-eff0-4169-b73e-246b8e1f34ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:16.317288 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-40b48902-eff0-4169-b73e-246b8e1f34ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:16.451553 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-40b48902-eff0-4169-b73e-246b8e1f34ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:16.459222 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-40b48902-eff0-4169-b73e-246b8e1f34ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.154822 May 12 09:36:16.459783 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 217/420] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:16 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:17.477490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b4778db5-05bc-448e-a975-7b6c82012aba tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:17.478261 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b4778db5-05bc-448e-a975-7b6c82012aba tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:17.484330 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b4778db5-05bc-448e-a975-7b6c82012aba tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:17.484778 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b4778db5-05bc-448e-a975-7b6c82012aba tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:17.485539 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b4778db5-05bc-448e-a975-7b6c82012aba tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:17.486000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b4778db5-05bc-448e-a975-7b6c82012aba tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:17.614207 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b4778db5-05bc-448e-a975-7b6c82012aba tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:17.621451 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b4778db5-05bc-448e-a975-7b6c82012aba tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.149102 May 12 09:36:17.622038 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 204/421] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:17 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:18.167483 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cd36218a-83b0-4d72-a429-b28f7eebf565 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "943f3031-8b1e-4be2-aa50-ad744878577d", "device": "/dev/sdb"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:36:18.169861 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cd36218a-83b0-4d72-a429-b28f7eebf565 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:18.176888 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd36218a-83b0-4d72-a429-b28f7eebf565 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:18.177339 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd36218a-83b0-4d72-a429-b28f7eebf565 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:18.178168 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd36218a-83b0-4d72-a429-b28f7eebf565 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:18.178601 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd36218a-83b0-4d72-a429-b28f7eebf565 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:18.639735 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-81faf161-8a70-4478-b3ce-7db23464ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:18.640362 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-81faf161-8a70-4478-b3ce-7db23464ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:18.647297 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-81faf161-8a70-4478-b3ce-7db23464ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:18.647752 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-81faf161-8a70-4478-b3ce-7db23464ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:18.648538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-81faf161-8a70-4478-b3ce-7db23464ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:18.648977 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-81faf161-8a70-4478-b3ce-7db23464ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:18.791130 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-81faf161-8a70-4478-b3ce-7db23464ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:18.812112 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-81faf161-8a70-4478-b3ce-7db23464ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.175332 May 12 09:36:18.813477 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 205/422] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:18 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:36:19.592441 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cd36218a-83b0-4d72-a429-b28f7eebf565 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "POST /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.430072 May 12 09:36:19.593183 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 218/423] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:36:18 2022] POST /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829/os-volume_attachments => generated 194 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:36:19.830980 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9269f954-179a-4222-a219-20c825ab5703 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:19.831653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9269f954-179a-4222-a219-20c825ab5703 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:19.838315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9269f954-179a-4222-a219-20c825ab5703 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:19.838766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9269f954-179a-4222-a219-20c825ab5703 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:19.839918 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9269f954-179a-4222-a219-20c825ab5703 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:19.840361 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9269f954-179a-4222-a219-20c825ab5703 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:19.973304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9269f954-179a-4222-a219-20c825ab5703 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:19.980441 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9269f954-179a-4222-a219-20c825ab5703 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.153264 May 12 09:36:19.981006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 206/424] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:19 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:21.009367 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7221adaa-0150-4c8f-821c-c6af754b0b65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:21.010122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7221adaa-0150-4c8f-821c-c6af754b0b65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:21.016614 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7221adaa-0150-4c8f-821c-c6af754b0b65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:21.017248 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7221adaa-0150-4c8f-821c-c6af754b0b65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:21.018237 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7221adaa-0150-4c8f-821c-c6af754b0b65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:21.018705 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7221adaa-0150-4c8f-821c-c6af754b0b65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:21.198782 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7221adaa-0150-4c8f-821c-c6af754b0b65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:21.208163 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7221adaa-0150-4c8f-821c-c6af754b0b65 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1521 microversion: 2.1 time: 0.213416 May 12 09:36:21.209428 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 219/425] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:20 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:22.227243 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-88879d0c-da83-4441-83c7-7e2de4cf532a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:22.227848 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-88879d0c-da83-4441-83c7-7e2de4cf532a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:22.234179 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-88879d0c-da83-4441-83c7-7e2de4cf532a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:22.234631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-88879d0c-da83-4441-83c7-7e2de4cf532a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:22.235389 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-88879d0c-da83-4441-83c7-7e2de4cf532a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:22.235827 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-88879d0c-da83-4441-83c7-7e2de4cf532a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:22.364293 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-88879d0c-da83-4441-83c7-7e2de4cf532a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:22.371972 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-88879d0c-da83-4441-83c7-7e2de4cf532a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1501 microversion: 2.1 time: 0.148484 May 12 09:36:22.372800 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 207/426] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:22 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:22.388733 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-981f3bc4-cf08-446d-bfaa-570f96ac19ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:22.389366 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-981f3bc4-cf08-446d-bfaa-570f96ac19ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:22.396303 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-981f3bc4-cf08-446d-bfaa-570f96ac19ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:22.396754 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-981f3bc4-cf08-446d-bfaa-570f96ac19ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:22.397531 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-981f3bc4-cf08-446d-bfaa-570f96ac19ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:22.398001 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-981f3bc4-cf08-446d-bfaa-570f96ac19ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:22.521461 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-981f3bc4-cf08-446d-bfaa-570f96ac19ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:22.528883 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-981f3bc4-cf08-446d-bfaa-570f96ac19ce tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1516 microversion: 2.1 time: 0.145185 May 12 09:36:22.529440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 220/427] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:22 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1516 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:24.142362 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-77c886c3-a9e4-46b4-9123-8e33102b6e42 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:24.142969 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-77c886c3-a9e4-46b4-9123-8e33102b6e42 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:24.149143 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-77c886c3-a9e4-46b4-9123-8e33102b6e42 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:24.149527 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-77c886c3-a9e4-46b4-9123-8e33102b6e42 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:24.150424 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-77c886c3-a9e4-46b4-9123-8e33102b6e42 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:24.150855 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-77c886c3-a9e4-46b4-9123-8e33102b6e42 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:24.278637 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-77c886c3-a9e4-46b4-9123-8e33102b6e42 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:24.288687 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-77c886c3-a9e4-46b4-9123-8e33102b6e42 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1593 microversion: 2.1 time: 0.149904 May 12 09:36:24.289343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 208/428] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:24 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:36:24.935247 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5900aaab-3487-4bbb-b45f-8cc29989a817 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:36:24.936945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5900aaab-3487-4bbb-b45f-8cc29989a817 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:24.949507 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5900aaab-3487-4bbb-b45f-8cc29989a817 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:24.950098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5900aaab-3487-4bbb-b45f-8cc29989a817 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:24.950768 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5900aaab-3487-4bbb-b45f-8cc29989a817 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:24.951205 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5900aaab-3487-4bbb-b45f-8cc29989a817 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:24.984992 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-5900aaab-3487-4bbb-b45f-8cc29989a817 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lazy-loading 'flavor' on Instance uuid 4ed911f6-afdf-49e6-9897-e51a903b7680 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:36:25.102140 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5900aaab-3487-4bbb-b45f-8cc29989a817 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680/action" status: 200 len: 32 microversion: 2.1 time: 0.171391 May 12 09:36:25.103686 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 221/429] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:36:24 2022] POST /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 09:36:25.113722 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-66b7769f-4324-461e-a967-ee956fefdd6c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:25.114580 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-66b7769f-4324-461e-a967-ee956fefdd6c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:25.120903 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66b7769f-4324-461e-a967-ee956fefdd6c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:25.121696 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66b7769f-4324-461e-a967-ee956fefdd6c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:25.122685 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66b7769f-4324-461e-a967-ee956fefdd6c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:25.123282 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66b7769f-4324-461e-a967-ee956fefdd6c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:25.426603 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-66b7769f-4324-461e-a967-ee956fefdd6c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:25.433949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-66b7769f-4324-461e-a967-ee956fefdd6c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.324371 May 12 09:36:25.434498 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 209/430] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:25 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:26.452329 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-383b54a1-a1fd-4f74-b0e4-6c96049a61fa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:26.453067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-383b54a1-a1fd-4f74-b0e4-6c96049a61fa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:26.460602 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-383b54a1-a1fd-4f74-b0e4-6c96049a61fa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:26.461054 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-383b54a1-a1fd-4f74-b0e4-6c96049a61fa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:26.461827 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-383b54a1-a1fd-4f74-b0e4-6c96049a61fa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:26.462287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-383b54a1-a1fd-4f74-b0e4-6c96049a61fa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:26.679631 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-383b54a1-a1fd-4f74-b0e4-6c96049a61fa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:26.686907 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-383b54a1-a1fd-4f74-b0e4-6c96049a61fa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.239136 May 12 09:36:26.687567 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 222/431] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:26 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:26.970679 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-8b1b730a-3ded-4adf-8191-349ce1e3386b req-15561192-8593-4ca1-881b-75af757d7af0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a158cc80-2631-4dba-8071-ef5e07ec8ba1", "tag": "3af65aa8-83b2-410d-b24d-4b9b1b6dd549"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:36:26.980676 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-8b1b730a-3ded-4adf-8191-349ce1e3386b req-15561192-8593-4ca1-881b-75af757d7af0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:26.981228 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-8b1b730a-3ded-4adf-8191-349ce1e3386b req-15561192-8593-4ca1-881b-75af757d7af0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:26.995287 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-8b1b730a-3ded-4adf-8191-349ce1e3386b req-15561192-8593-4ca1-881b-75af757d7af0 service nova] Creating event network-changed:3af65aa8-83b2-410d-b24d-4b9b1b6dd549 for instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 on hv-cinder-83769 May 12 09:36:27.000564 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-8b1b730a-3ded-4adf-8191-349ce1e3386b req-15561192-8593-4ca1-881b-75af757d7af0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033471 May 12 09:36:27.001164 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 210/432] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:36:27.705735 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-52747089-c61a-40a9-8a7f-2e68a7cba571 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:27.707005 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-52747089-c61a-40a9-8a7f-2e68a7cba571 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:27.719612 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-52747089-c61a-40a9-8a7f-2e68a7cba571 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:27.720295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-52747089-c61a-40a9-8a7f-2e68a7cba571 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:27.721249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-52747089-c61a-40a9-8a7f-2e68a7cba571 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:27.721854 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-52747089-c61a-40a9-8a7f-2e68a7cba571 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:27.914861 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-52747089-c61a-40a9-8a7f-2e68a7cba571 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:27.925098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-52747089-c61a-40a9-8a7f-2e68a7cba571 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.223860 May 12 09:36:27.926570 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 223/433] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:27 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:28.500777 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-eb25f689-7f98-46bb-9f55-12caa65fb553 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1094791940"}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:36:28.501408 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-eb25f689-7f98-46bb-9f55-12caa65fb553 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:28.508672 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eb25f689-7f98-46bb-9f55-12caa65fb553 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:28.509467 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eb25f689-7f98-46bb-9f55-12caa65fb553 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:28.510272 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eb25f689-7f98-46bb-9f55-12caa65fb553 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:28.510706 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eb25f689-7f98-46bb-9f55-12caa65fb553 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:28.640684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.network.security_group_api [None req-eb25f689-7f98-46bb-9f55-12caa65fb553 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Adding security group 6fcbc622-37f4-4d6d-89bf-754d452f6498 to port 3af65aa8-83b2-410d-b24d-4b9b1b6dd549 May 12 09:36:28.942883 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a1cb77de-ac21-41d5-9143-763408dc206c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:28.943413 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a1cb77de-ac21-41d5-9143-763408dc206c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:28.950563 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a1cb77de-ac21-41d5-9143-763408dc206c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:28.951014 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a1cb77de-ac21-41d5-9143-763408dc206c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:28.951791 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a1cb77de-ac21-41d5-9143-763408dc206c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:28.952228 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a1cb77de-ac21-41d5-9143-763408dc206c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:29.151126 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a1cb77de-ac21-41d5-9143-763408dc206c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:29.160200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a1cb77de-ac21-41d5-9143-763408dc206c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.220809 May 12 09:36:29.174876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-eb25f689-7f98-46bb-9f55-12caa65fb553 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "POST /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/action" status: 202 len: 0 microversion: 2.1 time: 0.678956 May 12 09:36:29.175536 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 211/434] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:36:28 2022] POST /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/action => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:36:29.178596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 224/435] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:28 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:36:29.180207 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-8423ed53-320b-4a58-aceb-347e47ccaeba req-53581815-b1d8-44a9-af31-204faaca33d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a158cc80-2631-4dba-8071-ef5e07ec8ba1", "tag": "3af65aa8-83b2-410d-b24d-4b9b1b6dd549"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:36:29.185720 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-01ad3b25-3bee-4403-a0e3-c23c0ef68863 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:29.186389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-01ad3b25-3bee-4403-a0e3-c23c0ef68863 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:29.192604 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-8423ed53-320b-4a58-aceb-347e47ccaeba req-53581815-b1d8-44a9-af31-204faaca33d0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:29.193263 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-8423ed53-320b-4a58-aceb-347e47ccaeba req-53581815-b1d8-44a9-af31-204faaca33d0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:29.201750 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-01ad3b25-3bee-4403-a0e3-c23c0ef68863 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:29.202239 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-01ad3b25-3bee-4403-a0e3-c23c0ef68863 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:29.208963 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-01ad3b25-3bee-4403-a0e3-c23c0ef68863 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:29.209802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-01ad3b25-3bee-4403-a0e3-c23c0ef68863 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:29.216867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-8423ed53-320b-4a58-aceb-347e47ccaeba req-53581815-b1d8-44a9-af31-204faaca33d0 service nova] Creating event network-changed:3af65aa8-83b2-410d-b24d-4b9b1b6dd549 for instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 on hv-cinder-83769 May 12 09:36:29.229198 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-8423ed53-320b-4a58-aceb-347e47ccaeba req-53581815-b1d8-44a9-af31-204faaca33d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052463 May 12 09:36:29.229802 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 212/436] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:36:29.392830 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-01ad3b25-3bee-4403-a0e3-c23c0ef68863 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:29.401228 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-01ad3b25-3bee-4403-a0e3-c23c0ef68863 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1759 microversion: 2.1 time: 0.219866 May 12 09:36:29.401799 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 225/437] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:29 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1759 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:30.178471 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6ad8b5ad-4dbf-4408-900d-a78ab7c5534c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:30.179143 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6ad8b5ad-4dbf-4408-900d-a78ab7c5534c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:30.185080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ad8b5ad-4dbf-4408-900d-a78ab7c5534c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:30.185526 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ad8b5ad-4dbf-4408-900d-a78ab7c5534c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:30.186315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ad8b5ad-4dbf-4408-900d-a78ab7c5534c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:30.186753 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ad8b5ad-4dbf-4408-900d-a78ab7c5534c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:30.318338 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6ad8b5ad-4dbf-4408-900d-a78ab7c5534c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:30.325715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6ad8b5ad-4dbf-4408-900d-a78ab7c5534c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.152480 May 12 09:36:30.326306 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 213/438] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:30 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:31.342804 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-06e11e39-832a-49e9-94f5-776461a350f9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:31.343329 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-06e11e39-832a-49e9-94f5-776461a350f9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:31.350298 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-06e11e39-832a-49e9-94f5-776461a350f9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:31.350769 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-06e11e39-832a-49e9-94f5-776461a350f9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:31.351518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-06e11e39-832a-49e9-94f5-776461a350f9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:31.351953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-06e11e39-832a-49e9-94f5-776461a350f9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:31.516318 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-06e11e39-832a-49e9-94f5-776461a350f9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:31.524975 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-06e11e39-832a-49e9-94f5-776461a350f9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.186069 May 12 09:36:31.536262 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 226/439] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:31 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:32.544009 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-97e2b1dd-b11b-4758-880f-724669b8eb2c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:32.544619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-97e2b1dd-b11b-4758-880f-724669b8eb2c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:32.551433 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-97e2b1dd-b11b-4758-880f-724669b8eb2c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:32.551882 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-97e2b1dd-b11b-4758-880f-724669b8eb2c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:32.552646 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-97e2b1dd-b11b-4758-880f-724669b8eb2c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:32.553078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-97e2b1dd-b11b-4758-880f-724669b8eb2c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:32.696700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-97e2b1dd-b11b-4758-880f-724669b8eb2c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:32.705044 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-97e2b1dd-b11b-4758-880f-724669b8eb2c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.165210 May 12 09:36:32.706070 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 214/440] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:32 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:33.723359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-27a554b6-972b-488a-9e0a-c20fd07cc65e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:33.723970 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-27a554b6-972b-488a-9e0a-c20fd07cc65e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:33.730335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27a554b6-972b-488a-9e0a-c20fd07cc65e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:33.730805 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27a554b6-972b-488a-9e0a-c20fd07cc65e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:33.731565 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27a554b6-972b-488a-9e0a-c20fd07cc65e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:33.732008 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27a554b6-972b-488a-9e0a-c20fd07cc65e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:33.855201 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-27a554b6-972b-488a-9e0a-c20fd07cc65e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:33.862408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-27a554b6-972b-488a-9e0a-c20fd07cc65e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.143568 May 12 09:36:33.863131 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 227/441] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:33 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:34.879095 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f04025f6-3914-498d-beba-3bd1c1eab162 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:34.879701 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f04025f6-3914-498d-beba-3bd1c1eab162 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:34.886221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f04025f6-3914-498d-beba-3bd1c1eab162 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:34.886674 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f04025f6-3914-498d-beba-3bd1c1eab162 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:34.887440 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f04025f6-3914-498d-beba-3bd1c1eab162 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:34.887877 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f04025f6-3914-498d-beba-3bd1c1eab162 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:35.013241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f04025f6-3914-498d-beba-3bd1c1eab162 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:35.021340 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f04025f6-3914-498d-beba-3bd1c1eab162 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.145977 May 12 09:36:35.022008 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 215/442] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:34 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:36.038040 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-94b988b8-080c-4b09-b5b9-40dc11f41063 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:36.038642 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-94b988b8-080c-4b09-b5b9-40dc11f41063 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:36.044928 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-94b988b8-080c-4b09-b5b9-40dc11f41063 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:36.045379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-94b988b8-080c-4b09-b5b9-40dc11f41063 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:36.046152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-94b988b8-080c-4b09-b5b9-40dc11f41063 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:36.046586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-94b988b8-080c-4b09-b5b9-40dc11f41063 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:36.399595 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-94b988b8-080c-4b09-b5b9-40dc11f41063 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:36.406822 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-94b988b8-080c-4b09-b5b9-40dc11f41063 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.372611 May 12 09:36:36.407396 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 228/443] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:36 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:37.423192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4e6ba656-0da1-485d-a6fa-ed32b66420a1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:37.423747 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4e6ba656-0da1-485d-a6fa-ed32b66420a1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:37.430539 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e6ba656-0da1-485d-a6fa-ed32b66420a1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:37.430989 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e6ba656-0da1-485d-a6fa-ed32b66420a1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:37.431752 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e6ba656-0da1-485d-a6fa-ed32b66420a1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:37.432188 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e6ba656-0da1-485d-a6fa-ed32b66420a1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:37.557524 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4e6ba656-0da1-485d-a6fa-ed32b66420a1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:37.564767 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4e6ba656-0da1-485d-a6fa-ed32b66420a1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.145476 May 12 09:36:37.565333 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 216/444] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:37 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:38.582755 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d1f4f7cf-ec38-459a-afb9-51f8140cab98 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:38.583366 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d1f4f7cf-ec38-459a-afb9-51f8140cab98 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:38.589647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d1f4f7cf-ec38-459a-afb9-51f8140cab98 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:38.590133 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d1f4f7cf-ec38-459a-afb9-51f8140cab98 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:38.590899 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d1f4f7cf-ec38-459a-afb9-51f8140cab98 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:38.591335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d1f4f7cf-ec38-459a-afb9-51f8140cab98 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:38.720189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d1f4f7cf-ec38-459a-afb9-51f8140cab98 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:38.727530 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d1f4f7cf-ec38-459a-afb9-51f8140cab98 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.149162 May 12 09:36:38.728047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 229/445] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:38 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:39.744102 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1d8a7fbb-68a0-4a57-a88f-640bfb7cdbfc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:39.744811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1d8a7fbb-68a0-4a57-a88f-640bfb7cdbfc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:39.753719 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1d8a7fbb-68a0-4a57-a88f-640bfb7cdbfc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:39.754193 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1d8a7fbb-68a0-4a57-a88f-640bfb7cdbfc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:39.754962 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1d8a7fbb-68a0-4a57-a88f-640bfb7cdbfc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:39.755396 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1d8a7fbb-68a0-4a57-a88f-640bfb7cdbfc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:39.884352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1d8a7fbb-68a0-4a57-a88f-640bfb7cdbfc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:39.892770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1d8a7fbb-68a0-4a57-a88f-640bfb7cdbfc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.152453 May 12 09:36:39.893383 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 217/446] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:39 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:40.910395 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-735a95c0-fa88-4b88-94b2-6ab1602f223f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:40.912474 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-735a95c0-fa88-4b88-94b2-6ab1602f223f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:40.918105 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-735a95c0-fa88-4b88-94b2-6ab1602f223f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:40.918795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-735a95c0-fa88-4b88-94b2-6ab1602f223f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:40.920032 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-735a95c0-fa88-4b88-94b2-6ab1602f223f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:40.920729 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-735a95c0-fa88-4b88-94b2-6ab1602f223f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:41.049874 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-735a95c0-fa88-4b88-94b2-6ab1602f223f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:41.057249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-735a95c0-fa88-4b88-94b2-6ab1602f223f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.151345 May 12 09:36:41.057931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 230/447] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:40 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:42.074280 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-720774f3-23cb-4906-917c-37a8dc48c008 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:42.074896 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-720774f3-23cb-4906-917c-37a8dc48c008 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:42.081668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-720774f3-23cb-4906-917c-37a8dc48c008 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:42.082160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-720774f3-23cb-4906-917c-37a8dc48c008 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:42.082931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-720774f3-23cb-4906-917c-37a8dc48c008 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:42.083371 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-720774f3-23cb-4906-917c-37a8dc48c008 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:42.210028 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-720774f3-23cb-4906-917c-37a8dc48c008 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:42.217247 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-720774f3-23cb-4906-917c-37a8dc48c008 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.146830 May 12 09:36:42.217811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 218/448] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:42 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:43.234082 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1c4c0f8f-c999-47b1-b151-928dc5dc4520 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:43.234712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1c4c0f8f-c999-47b1-b151-928dc5dc4520 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:43.241443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1c4c0f8f-c999-47b1-b151-928dc5dc4520 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:43.241885 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1c4c0f8f-c999-47b1-b151-928dc5dc4520 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:43.242661 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1c4c0f8f-c999-47b1-b151-928dc5dc4520 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:43.243089 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1c4c0f8f-c999-47b1-b151-928dc5dc4520 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:43.374677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1c4c0f8f-c999-47b1-b151-928dc5dc4520 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:43.382596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1c4c0f8f-c999-47b1-b151-928dc5dc4520 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.152364 May 12 09:36:43.383161 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 231/449] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:43 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:44.400388 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b3bc272e-5375-4d31-9baf-c968f20077ab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:44.400918 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b3bc272e-5375-4d31-9baf-c968f20077ab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:44.407072 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b3bc272e-5375-4d31-9baf-c968f20077ab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:44.407511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b3bc272e-5375-4d31-9baf-c968f20077ab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:44.408258 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b3bc272e-5375-4d31-9baf-c968f20077ab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:44.408688 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b3bc272e-5375-4d31-9baf-c968f20077ab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:44.533744 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b3bc272e-5375-4d31-9baf-c968f20077ab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:44.541168 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b3bc272e-5375-4d31-9baf-c968f20077ab tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.144703 May 12 09:36:44.541724 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 219/450] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:44 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:45.557953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-30a8e55a-7e1e-4ee7-b07c-4bb391e3a143 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:45.558576 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-30a8e55a-7e1e-4ee7-b07c-4bb391e3a143 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:45.564897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-30a8e55a-7e1e-4ee7-b07c-4bb391e3a143 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:45.565935 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-30a8e55a-7e1e-4ee7-b07c-4bb391e3a143 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:45.566708 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-30a8e55a-7e1e-4ee7-b07c-4bb391e3a143 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:45.567178 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-30a8e55a-7e1e-4ee7-b07c-4bb391e3a143 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:45.695064 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-30a8e55a-7e1e-4ee7-b07c-4bb391e3a143 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:45.702487 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-30a8e55a-7e1e-4ee7-b07c-4bb391e3a143 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.148254 May 12 09:36:45.703325 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 232/451] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:45 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:46.721260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-17cc3b99-06cc-4dfd-b033-474a59c734a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:46.721906 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-17cc3b99-06cc-4dfd-b033-474a59c734a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:46.727740 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17cc3b99-06cc-4dfd-b033-474a59c734a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:46.728193 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17cc3b99-06cc-4dfd-b033-474a59c734a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:46.728958 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17cc3b99-06cc-4dfd-b033-474a59c734a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:46.729397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17cc3b99-06cc-4dfd-b033-474a59c734a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:46.857463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-17cc3b99-06cc-4dfd-b033-474a59c734a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:46.864689 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-17cc3b99-06cc-4dfd-b033-474a59c734a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.148062 May 12 09:36:46.865260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 220/452] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:46 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:47.881778 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6968041c-2c64-4d65-90f1-254a1d523de3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:47.882333 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6968041c-2c64-4d65-90f1-254a1d523de3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:47.888858 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6968041c-2c64-4d65-90f1-254a1d523de3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:47.889303 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6968041c-2c64-4d65-90f1-254a1d523de3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:47.890090 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6968041c-2c64-4d65-90f1-254a1d523de3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:47.890526 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6968041c-2c64-4d65-90f1-254a1d523de3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:48.012786 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6968041c-2c64-4d65-90f1-254a1d523de3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:48.020016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6968041c-2c64-4d65-90f1-254a1d523de3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.142815 May 12 09:36:48.020576 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 233/453] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:47 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:49.037275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1a72cd2e-f217-4916-8979-91e5cde6ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:49.037958 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1a72cd2e-f217-4916-8979-91e5cde6ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:49.044078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1a72cd2e-f217-4916-8979-91e5cde6ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:49.044525 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1a72cd2e-f217-4916-8979-91e5cde6ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:49.045273 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1a72cd2e-f217-4916-8979-91e5cde6ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:49.045703 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1a72cd2e-f217-4916-8979-91e5cde6ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:49.176869 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1a72cd2e-f217-4916-8979-91e5cde6ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:49.184097 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1a72cd2e-f217-4916-8979-91e5cde6ca87 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.151125 May 12 09:36:49.184659 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 221/454] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:49 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:50.201265 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-012a659d-f640-468d-89e1-5d071ef99089 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:50.201875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-012a659d-f640-468d-89e1-5d071ef99089 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:50.208242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-012a659d-f640-468d-89e1-5d071ef99089 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:50.208702 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-012a659d-f640-468d-89e1-5d071ef99089 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:50.209467 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-012a659d-f640-468d-89e1-5d071ef99089 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:50.209921 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-012a659d-f640-468d-89e1-5d071ef99089 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:50.337152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-012a659d-f640-468d-89e1-5d071ef99089 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:50.347808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-012a659d-f640-468d-89e1-5d071ef99089 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.150311 May 12 09:36:50.348536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 234/455] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:50 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:51.365769 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1d4f6a57-4704-4010-9961-f6c328ad57cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:51.366751 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1d4f6a57-4704-4010-9961-f6c328ad57cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:51.374811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1d4f6a57-4704-4010-9961-f6c328ad57cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:51.375463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1d4f6a57-4704-4010-9961-f6c328ad57cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:51.376286 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1d4f6a57-4704-4010-9961-f6c328ad57cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:51.376728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1d4f6a57-4704-4010-9961-f6c328ad57cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:51.505383 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1d4f6a57-4704-4010-9961-f6c328ad57cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:51.514152 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1d4f6a57-4704-4010-9961-f6c328ad57cf tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.152692 May 12 09:36:51.514754 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 222/456] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:51 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:52.530812 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-755a9987-838a-408d-a44c-7961b7384814 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:52.531414 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-755a9987-838a-408d-a44c-7961b7384814 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:52.538326 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-755a9987-838a-408d-a44c-7961b7384814 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:52.538767 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-755a9987-838a-408d-a44c-7961b7384814 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:52.539520 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-755a9987-838a-408d-a44c-7961b7384814 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:52.539946 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-755a9987-838a-408d-a44c-7961b7384814 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:52.668851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-755a9987-838a-408d-a44c-7961b7384814 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:52.678166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-755a9987-838a-408d-a44c-7961b7384814 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.150769 May 12 09:36:52.679184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 235/457] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:52 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:53.695473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4b952750-4951-4b33-a12f-f5f14912959b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:53.696084 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4b952750-4951-4b33-a12f-f5f14912959b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:53.702390 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4b952750-4951-4b33-a12f-f5f14912959b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:53.702981 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4b952750-4951-4b33-a12f-f5f14912959b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:53.703896 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4b952750-4951-4b33-a12f-f5f14912959b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:53.704433 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4b952750-4951-4b33-a12f-f5f14912959b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:53.843554 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4b952750-4951-4b33-a12f-f5f14912959b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:53.851276 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4b952750-4951-4b33-a12f-f5f14912959b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.159635 May 12 09:36:53.851840 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 223/458] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:53 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:54.868321 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1ba75e2f-8054-423b-ab03-7e38ad5b4f19 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:54.868927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1ba75e2f-8054-423b-ab03-7e38ad5b4f19 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:54.875229 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ba75e2f-8054-423b-ab03-7e38ad5b4f19 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:54.875684 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ba75e2f-8054-423b-ab03-7e38ad5b4f19 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:54.876444 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ba75e2f-8054-423b-ab03-7e38ad5b4f19 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:54.876881 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ba75e2f-8054-423b-ab03-7e38ad5b4f19 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:55.005817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1ba75e2f-8054-423b-ab03-7e38ad5b4f19 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:55.013269 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1ba75e2f-8054-423b-ab03-7e38ad5b4f19 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.148763 May 12 09:36:55.013819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 236/459] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:54 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:56.029845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-20a1c626-acc6-4e77-9641-929d0714e436 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:56.030473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-20a1c626-acc6-4e77-9641-929d0714e436 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:56.036780 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20a1c626-acc6-4e77-9641-929d0714e436 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:56.037223 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20a1c626-acc6-4e77-9641-929d0714e436 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:56.038018 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20a1c626-acc6-4e77-9641-929d0714e436 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:56.038451 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20a1c626-acc6-4e77-9641-929d0714e436 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:56.162994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-20a1c626-acc6-4e77-9641-929d0714e436 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:56.170252 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-20a1c626-acc6-4e77-9641-929d0714e436 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.144102 May 12 09:36:56.170822 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 224/460] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:56 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:57.187515 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b5d44527-ba3d-40d8-976d-1f6c7dad36db tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:57.188055 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b5d44527-ba3d-40d8-976d-1f6c7dad36db tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:57.194981 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b5d44527-ba3d-40d8-976d-1f6c7dad36db tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:57.195428 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b5d44527-ba3d-40d8-976d-1f6c7dad36db tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:57.196182 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b5d44527-ba3d-40d8-976d-1f6c7dad36db tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:57.196611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b5d44527-ba3d-40d8-976d-1f6c7dad36db tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:57.324728 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b5d44527-ba3d-40d8-976d-1f6c7dad36db tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:57.332378 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b5d44527-ba3d-40d8-976d-1f6c7dad36db tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.148726 May 12 09:36:57.332933 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 237/461] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:57 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:58.348490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-31b703ef-4d9e-4115-be99-1abc11b9eb0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:58.349129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-31b703ef-4d9e-4115-be99-1abc11b9eb0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:58.355529 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31b703ef-4d9e-4115-be99-1abc11b9eb0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:58.355985 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31b703ef-4d9e-4115-be99-1abc11b9eb0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:58.356748 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31b703ef-4d9e-4115-be99-1abc11b9eb0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:58.357185 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31b703ef-4d9e-4115-be99-1abc11b9eb0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:58.480560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-31b703ef-4d9e-4115-be99-1abc11b9eb0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:58.488264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-31b703ef-4d9e-4115-be99-1abc11b9eb0e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.143677 May 12 09:36:58.488830 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 225/462] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:58 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:36:59.505607 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ffc79adf-b9e6-486c-bc31-ac257818bfb6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:36:59.506172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ffc79adf-b9e6-486c-bc31-ac257818bfb6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:36:59.512604 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ffc79adf-b9e6-486c-bc31-ac257818bfb6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:59.513047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ffc79adf-b9e6-486c-bc31-ac257818bfb6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:59.513795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ffc79adf-b9e6-486c-bc31-ac257818bfb6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:36:59.514255 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ffc79adf-b9e6-486c-bc31-ac257818bfb6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:36:59.639900 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ffc79adf-b9e6-486c-bc31-ac257818bfb6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:36:59.647645 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ffc79adf-b9e6-486c-bc31-ac257818bfb6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.146515 May 12 09:36:59.648210 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 238/463] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:36:59 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:00.664374 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3413a833-ba0f-4e07-99fb-44a1dbd3dcae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:00.664987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3413a833-ba0f-4e07-99fb-44a1dbd3dcae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:00.671336 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3413a833-ba0f-4e07-99fb-44a1dbd3dcae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:00.671788 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3413a833-ba0f-4e07-99fb-44a1dbd3dcae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:00.672552 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3413a833-ba0f-4e07-99fb-44a1dbd3dcae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:00.672992 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3413a833-ba0f-4e07-99fb-44a1dbd3dcae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:00.800999 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-3413a833-ba0f-4e07-99fb-44a1dbd3dcae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:00.808193 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3413a833-ba0f-4e07-99fb-44a1dbd3dcae tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.147650 May 12 09:37:00.808756 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 226/464] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:00 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:01.826942 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a05c56da-c28d-4f4b-acea-1f156322af2d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:01.827542 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a05c56da-c28d-4f4b-acea-1f156322af2d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:01.834505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a05c56da-c28d-4f4b-acea-1f156322af2d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:01.834955 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a05c56da-c28d-4f4b-acea-1f156322af2d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:01.835711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a05c56da-c28d-4f4b-acea-1f156322af2d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:01.836147 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a05c56da-c28d-4f4b-acea-1f156322af2d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:01.975590 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a05c56da-c28d-4f4b-acea-1f156322af2d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:01.984324 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a05c56da-c28d-4f4b-acea-1f156322af2d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.161163 May 12 09:37:01.984896 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 239/465] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:01 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:03.001149 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9c5170a3-0005-4d67-bea2-994d2be2658f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:03.001757 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9c5170a3-0005-4d67-bea2-994d2be2658f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:03.008271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9c5170a3-0005-4d67-bea2-994d2be2658f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:03.008720 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9c5170a3-0005-4d67-bea2-994d2be2658f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:03.009742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9c5170a3-0005-4d67-bea2-994d2be2658f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:03.010205 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9c5170a3-0005-4d67-bea2-994d2be2658f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:03.138310 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9c5170a3-0005-4d67-bea2-994d2be2658f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:03.145599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9c5170a3-0005-4d67-bea2-994d2be2658f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1502 microversion: 2.1 time: 0.148268 May 12 09:37:03.146211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 227/466] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:02 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:03.163215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e6c539c-1983-4dce-a9a5-57f6570881ca"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:03.164379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:03.170697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:03.171151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:03.171916 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:03.172480 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:03.195872 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] HTTP exception thrown: Cannot 'attach_volume' instance 4ed911f6-afdf-49e6-9897-e51a903b7680 while it is in vm_state rescued May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Request method failure captured: May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: POST /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680/os-volume_attachments HTTP/1.1 May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 74 May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNSHHvU-xPgJBPK25GvnemOotOHXGR0HdgQPjtw_xG3Fwc7xiEp59twyMvS4dmFXXond1D1lBsIZB4epBrlw8xntQZNkPOZPFXm1geBWQmpvwFvIdNdGKHmQ25SDCzgUNge48cZXntjNIfKPx_yscMzVLp4b9yU0ICymRlftgT-dJlo May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:37:03.197463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c54669eadc784d4aac5d1a40d18858b1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}] May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 0b01be56426e4ff1a09577f30fb79f0b May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {"volumeAttachment": {"volumeId": "0e6c539c-1983-4dce-a9a5-57f6570881ca"}} May 12 09:37:03.199065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Cannot 'attach_volume' instance 4ed911f6-afdf-49e6-9897-e51a903b7680 while it is in vm_state rescued May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'server_id': '4ed911f6-afdf-49e6-9897-e51a903b7680', 'body': {'volumeAttachment': {'volumeId': '0e6c539c-1983-4dce-a9a5-57f6570881ca'}}} May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4ed911f6-afdf-49e6-9897-e51a903b7680 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:37:03.199989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4ed911f6-afdf-49e6-9897-e51a903b7680 while it is in vm_state rescued May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:37:03.201330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:37:03.202752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:37:03.202752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:37:03.202752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4ed911f6-afdf-49e6-9897-e51a903b7680 while it is in vm_state rescued May 12 09:37:03.202752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:03.202752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Returning 409 to user: Cannot 'attach_volume' instance 4ed911f6-afdf-49e6-9897-e51a903b7680 while it is in vm_state rescued {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:37:03.202752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8d31e03d-0ce3-418a-b866-67575fd7f7fc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041921 May 12 09:37:03.202752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 240/467] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:37:03 2022] POST /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 09:37:03.212564 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3b46c514-95d5-4758-a578-bcbd69bdc605 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:03.213161 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3b46c514-95d5-4758-a578-bcbd69bdc605 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:03.219062 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3b46c514-95d5-4758-a578-bcbd69bdc605 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:03.219792 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3b46c514-95d5-4758-a578-bcbd69bdc605 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:03.220455 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3b46c514-95d5-4758-a578-bcbd69bdc605 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:03.221603 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3b46c514-95d5-4758-a578-bcbd69bdc605 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:03.290985 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3b46c514-95d5-4758-a578-bcbd69bdc605 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680/action" status: 202 len: 0 microversion: 2.1 time: 0.082388 May 12 09:37:03.295315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 228/468] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:37:03 2022] POST /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:37:03.300733 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2e170ee0-6d1f-4d85-89a6-5c8e5fd94a50 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:03.301340 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2e170ee0-6d1f-4d85-89a6-5c8e5fd94a50 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:03.310936 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e170ee0-6d1f-4d85-89a6-5c8e5fd94a50 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:03.311390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e170ee0-6d1f-4d85-89a6-5c8e5fd94a50 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:03.312157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e170ee0-6d1f-4d85-89a6-5c8e5fd94a50 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:03.312588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e170ee0-6d1f-4d85-89a6-5c8e5fd94a50 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:03.500274 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2e170ee0-6d1f-4d85-89a6-5c8e5fd94a50 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:03.508000 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2e170ee0-6d1f-4d85-89a6-5c8e5fd94a50 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1510 microversion: 2.1 time: 0.211899 May 12 09:37:03.509226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 241/469] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:03 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:37:04.067892 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7819f0d9-5cdd-4602-8f8e-968b6b3a5364 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:04.068453 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7819f0d9-5cdd-4602-8f8e-968b6b3a5364 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:04.074629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7819f0d9-5cdd-4602-8f8e-968b6b3a5364 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:04.075176 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7819f0d9-5cdd-4602-8f8e-968b6b3a5364 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:04.075948 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7819f0d9-5cdd-4602-8f8e-968b6b3a5364 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:04.076387 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7819f0d9-5cdd-4602-8f8e-968b6b3a5364 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:04.206371 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-7819f0d9-5cdd-4602-8f8e-968b6b3a5364 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lazy-loading 'services' on Instance uuid 56d286f5-766e-42c0-a80c-4526ac1b3829 {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:37:04.332754 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7819f0d9-5cdd-4602-8f8e-968b6b3a5364 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "DELETE /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829/os-volume_attachments/943f3031-8b1e-4be2-aa50-ad744878577d" status: 202 len: 0 microversion: 2.1 time: 0.269942 May 12 09:37:04.333367 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 229/470] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:37:04 2022] DELETE /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829/os-volume_attachments/943f3031-8b1e-4be2-aa50-ad744878577d => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:37:04.526040 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e3fb04a6-bcf4-48eb-977c-2c0071f22693 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:04.526584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e3fb04a6-bcf4-48eb-977c-2c0071f22693 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:04.532977 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3fb04a6-bcf4-48eb-977c-2c0071f22693 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:04.533537 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3fb04a6-bcf4-48eb-977c-2c0071f22693 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:04.535235 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3fb04a6-bcf4-48eb-977c-2c0071f22693 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:04.535674 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3fb04a6-bcf4-48eb-977c-2c0071f22693 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:04.668550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e3fb04a6-bcf4-48eb-977c-2c0071f22693 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:04.676440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e3fb04a6-bcf4-48eb-977c-2c0071f22693 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1510 microversion: 2.1 time: 0.154235 May 12 09:37:04.677233 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 242/471] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:04 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:05.695144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c1d413d5-eade-4008-b151-0d5d2a513031 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:05.696169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c1d413d5-eade-4008-b151-0d5d2a513031 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:05.702191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c1d413d5-eade-4008-b151-0d5d2a513031 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:05.702643 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c1d413d5-eade-4008-b151-0d5d2a513031 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:05.703406 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c1d413d5-eade-4008-b151-0d5d2a513031 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:05.703839 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c1d413d5-eade-4008-b151-0d5d2a513031 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:05.842339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c1d413d5-eade-4008-b151-0d5d2a513031 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:05.851311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c1d413d5-eade-4008-b151-0d5d2a513031 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1510 microversion: 2.1 time: 0.160718 May 12 09:37:05.851882 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 230/472] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:05 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:06.868560 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f47a0dc5-ddb2-49b3-a614-c31bcc318887 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:06.869272 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f47a0dc5-ddb2-49b3-a614-c31bcc318887 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:06.876944 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f47a0dc5-ddb2-49b3-a614-c31bcc318887 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:06.876944 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f47a0dc5-ddb2-49b3-a614-c31bcc318887 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:06.876944 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f47a0dc5-ddb2-49b3-a614-c31bcc318887 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:06.877375 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f47a0dc5-ddb2-49b3-a614-c31bcc318887 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:07.007867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f47a0dc5-ddb2-49b3-a614-c31bcc318887 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:07.015325 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f47a0dc5-ddb2-49b3-a614-c31bcc318887 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1510 microversion: 2.1 time: 0.150824 May 12 09:37:07.015891 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 243/473] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:06 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:08.032706 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-500c4fed-2555-4bbf-b111-ca1e846407c1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:08.033804 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-500c4fed-2555-4bbf-b111-ca1e846407c1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:08.040423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-500c4fed-2555-4bbf-b111-ca1e846407c1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:08.040867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-500c4fed-2555-4bbf-b111-ca1e846407c1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:08.041628 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-500c4fed-2555-4bbf-b111-ca1e846407c1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:08.042089 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-500c4fed-2555-4bbf-b111-ca1e846407c1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:08.172651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-500c4fed-2555-4bbf-b111-ca1e846407c1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:08.180795 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-500c4fed-2555-4bbf-b111-ca1e846407c1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1510 microversion: 2.1 time: 0.151711 May 12 09:37:08.181297 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 231/474] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:08 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:09.197753 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-defe5353-4ad9-4792-9edd-19baa4d144f4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:09.198493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-defe5353-4ad9-4792-9edd-19baa4d144f4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:09.204808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-defe5353-4ad9-4792-9edd-19baa4d144f4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:09.205832 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-defe5353-4ad9-4792-9edd-19baa4d144f4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:09.206846 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-defe5353-4ad9-4792-9edd-19baa4d144f4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:09.207280 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-defe5353-4ad9-4792-9edd-19baa4d144f4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:09.349012 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-defe5353-4ad9-4792-9edd-19baa4d144f4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:09.356811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-defe5353-4ad9-4792-9edd-19baa4d144f4 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1510 microversion: 2.1 time: 0.162808 May 12 09:37:09.357853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 244/475] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:09 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:10.373297 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-83a9135f-f772-474c-92ae-5bfe84ef1c16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:10.373824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-83a9135f-f772-474c-92ae-5bfe84ef1c16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:10.380750 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-83a9135f-f772-474c-92ae-5bfe84ef1c16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:10.381203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-83a9135f-f772-474c-92ae-5bfe84ef1c16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:10.382007 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-83a9135f-f772-474c-92ae-5bfe84ef1c16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:10.382500 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-83a9135f-f772-474c-92ae-5bfe84ef1c16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:10.511143 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-83a9135f-f772-474c-92ae-5bfe84ef1c16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:10.514166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:37:10.514647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Thu May 12 09:37:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:37:10.520453 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-83a9135f-f772-474c-92ae-5bfe84ef1c16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1510 microversion: 2.1 time: 0.151093 May 12 09:37:10.521017 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 232/476] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:10 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:37:10.724710 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-406f83f5-431e-4a0a-b5eb-bae341eebc40 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:10.725204 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-406f83f5-431e-4a0a-b5eb-bae341eebc40 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:10.735222 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-406f83f5-431e-4a0a-b5eb-bae341eebc40 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:10.735712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-406f83f5-431e-4a0a-b5eb-bae341eebc40 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:10.736683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-406f83f5-431e-4a0a-b5eb-bae341eebc40 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:10.737050 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-406f83f5-431e-4a0a-b5eb-bae341eebc40 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:10.770448 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-406f83f5-431e-4a0a-b5eb-bae341eebc40 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:37:10.843164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-406f83f5-431e-4a0a-b5eb-bae341eebc40 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "DELETE /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 204 len: 0 microversion: 2.1 time: 0.122428 May 12 09:37:10.843751 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 245/477] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:37:10 2022] DELETE /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:37:10.853195 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4dba8e3c-314d-4353-b700-59bf95978c01 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:10.854063 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4dba8e3c-314d-4353-b700-59bf95978c01 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:10.860000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4dba8e3c-314d-4353-b700-59bf95978c01 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:10.860607 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4dba8e3c-314d-4353-b700-59bf95978c01 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:10.861393 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4dba8e3c-314d-4353-b700-59bf95978c01 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:10.861822 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4dba8e3c-314d-4353-b700-59bf95978c01 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:10.990239 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4dba8e3c-314d-4353-b700-59bf95978c01 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:10.997392 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4dba8e3c-314d-4353-b700-59bf95978c01 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1512 microversion: 2.1 time: 0.148555 May 12 09:37:10.997971 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 233/478] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:10 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:11.537048 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9a6e6468-9e05-480b-93b3-3aa244582aa6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:11.537764 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9a6e6468-9e05-480b-93b3-3aa244582aa6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:11.543498 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a6e6468-9e05-480b-93b3-3aa244582aa6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:11.543955 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a6e6468-9e05-480b-93b3-3aa244582aa6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:11.544727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a6e6468-9e05-480b-93b3-3aa244582aa6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:11.545169 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a6e6468-9e05-480b-93b3-3aa244582aa6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:11.682975 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9a6e6468-9e05-480b-93b3-3aa244582aa6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:11.691191 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9a6e6468-9e05-480b-93b3-3aa244582aa6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1516 microversion: 2.1 time: 0.158419 May 12 09:37:11.691762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 246/479] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:11 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:12.015180 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-78c285a3-52e8-4eb8-8295-91ea104086a7 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:12.015894 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-78c285a3-52e8-4eb8-8295-91ea104086a7 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:12.025631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-78c285a3-52e8-4eb8-8295-91ea104086a7 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:12.026180 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-78c285a3-52e8-4eb8-8295-91ea104086a7 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:12.027134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-78c285a3-52e8-4eb8-8295-91ea104086a7 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:12.027774 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-78c285a3-52e8-4eb8-8295-91ea104086a7 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:12.167469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-78c285a3-52e8-4eb8-8295-91ea104086a7 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:12.175422 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-78c285a3-52e8-4eb8-8295-91ea104086a7 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1512 microversion: 2.1 time: 0.164045 May 12 09:37:12.175999 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 234/480] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:12 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:13.191736 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-62a2defe-36a2-4e54-bd70-914fc3e74da1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:13.192354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-62a2defe-36a2-4e54-bd70-914fc3e74da1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:13.198631 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-62a2defe-36a2-4e54-bd70-914fc3e74da1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:13.199085 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-62a2defe-36a2-4e54-bd70-914fc3e74da1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:13.199849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-62a2defe-36a2-4e54-bd70-914fc3e74da1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:13.200287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-62a2defe-36a2-4e54-bd70-914fc3e74da1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:13.333520 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-62a2defe-36a2-4e54-bd70-914fc3e74da1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:13.340792 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-62a2defe-36a2-4e54-bd70-914fc3e74da1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1512 microversion: 2.1 time: 0.152903 May 12 09:37:13.341350 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 247/481] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:13 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:13.746761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-a8b8fada-46bc-45c5-8bed-9dd0640e79f5 req-d0b1a7d4-af89-4594-b11a-1051660e6a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d286f5-766e-42c0-a80c-4526ac1b3829", "name": "network-vif-deleted", "tag": "50f1df2b-d761-4daf-aea9-a81a341d7a3c"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:13.757916 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-a8b8fada-46bc-45c5-8bed-9dd0640e79f5 req-d0b1a7d4-af89-4594-b11a-1051660e6a06 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:13.758382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-a8b8fada-46bc-45c5-8bed-9dd0640e79f5 req-d0b1a7d4-af89-4594-b11a-1051660e6a06 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:13.769997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-a8b8fada-46bc-45c5-8bed-9dd0640e79f5 req-d0b1a7d4-af89-4594-b11a-1051660e6a06 service nova] Creating event network-vif-deleted:50f1df2b-d761-4daf-aea9-a81a341d7a3c for instance 56d286f5-766e-42c0-a80c-4526ac1b3829 on hv-cinder-83769 May 12 09:37:13.775622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-a8b8fada-46bc-45c5-8bed-9dd0640e79f5 req-d0b1a7d4-af89-4594-b11a-1051660e6a06 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032242 May 12 09:37:13.776299 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 235/482] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:37:14.102246 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-58abd3a7-dc54-46e7-b60c-2991138b4714 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'create', calling method: .version_select at 0x7f872597bee0>, body: {"keypair": {"name": "tempest-keypair-1024423975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6Tp+OuXjGv4E8zT+JBBrmlXFhaIrudbG25rwmxjZXsTBN3JR35UGmn6K2/hsH574Iw6oPP0PxeuPcN9C1qnZApMOBZ+JTbexyAfOhpHQc7+TZUDJC5LpOE7kEQ2GLIJQ=="}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:14.115612 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-58abd3a7-dc54-46e7-b60c-2991138b4714 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Getting quotas for project c54669eadc784d4aac5d1a40d18858b1. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:37:14.120011 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-58abd3a7-dc54-46e7-b60c-2991138b4714 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Getting quotas for user 0b01be56426e4ff1a09577f30fb79f0b and project c54669eadc784d4aac5d1a40d18858b1. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:37:14.152898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-58abd3a7-dc54-46e7-b60c-2991138b4714 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058239 May 12 09:37:14.153794 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 248/483] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:37:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:37:14.357817 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:14.358959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:14.365789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:14.366282 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:14.367050 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:14.367660 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:14.413653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:14.414413 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:14.414872 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lazy-loading 'fault' on Instance uuid 56d286f5-766e-42c0-a80c-4526ac1b3829 {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:37:14.465569 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:14.474687 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6ff242ea-f1b0-4473-84fc-84c334778cfa tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 200 len: 1308 microversion: 2.1 time: 0.121029 May 12 09:37:14.475473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 236/484] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:14 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:15.492508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:15.493128 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: 56d286f5-766e-42c0-a80c-4526ac1b3829] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:15.501083 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:15.502739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:15.503528 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:15.503965 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:15.523966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] HTTP exception thrown: Instance 56d286f5-766e-42c0-a80c-4526ac1b3829 could not be found. May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Request method failure captured: May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 HTTP/1.1 May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNSkuhwIOzSrLDGD03M1ob123pgH2AJiVgIge9cgDne3QX0CCrO3IY8Q6d9gLDyaFyAWivzzFoPx6UuahZxQrNnkACijSv9oK-0cn1V_s3V4zdD02Dyo1l7GAyq-0jQY41UV_SJ6pvdrp6MCzrJt9Uiy_g4yz15zWfYYhYO1TXWheyQ May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: 59546c2ca0074bb5b77b7c5e64d9c068 May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesSnapshotTestJSON-625626064 May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:37:15.525419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_59546c2ca0074bb5b77b7c5e64d9c068", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59546c2ca0074bb5b77b7c5e64d9c068"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/59546c2ca0074bb5b77b7c5e64d9c068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59546c2ca0074bb5b77b7c5e64d9c068"}]}] May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesSnapshotTestJSON-625626064 May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: 59546c2ca0074bb5b77b7c5e64d9c068 May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-625626064 May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesSnapshotTestJSON-625626064-project May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 7dd6d3e1b6ea49d4a75e5f7e105ea0f0 May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesSnapshotTestJSON-625626064-project May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance 56d286f5-766e-42c0-a80c-4526ac1b3829 could not be found. May 12 09:37:15.526795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '56d286f5-766e-42c0-a80c-4526ac1b3829'} May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d286f5-766e-42c0-a80c-4526ac1b3829 could not be found. May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:37:15.527711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d286f5-766e-42c0-a80c-4526ac1b3829 could not be found. May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d286f5-766e-42c0-a80c-4526ac1b3829 could not be found. May 12 09:37:15.529091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:37:15.530183 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Returning 404 to user: Instance 56d286f5-766e-42c0-a80c-4526ac1b3829 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:37:15.530183 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-01011e04-75ad-41a9-ab5a-ab03ee6ebf29 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829" status: 404 len: 111 microversion: 2.1 time: 0.038790 May 12 09:37:15.530183 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 249/485] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:15 2022] GET /compute/v2.1/servers/56d286f5-766e-42c0-a80c-4526ac1b3829 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:37:15.631475 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-227333758", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94c124bd-d4ff-4709-8b22-7520113efef5"}], "security_groups": [{"name": "tempest-securitygroup--532250647"}], "key_name": "tempest-keypair-1024423975", "user_data": "}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:15.745342 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] validate_networks() for [('94c124bd-d4ff-4709-8b22-7520113efef5', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:37:16.142628 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:37:16.143069 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:37:16.143600 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:37:16.143923 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:37:16.144326 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:37:16.152823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:16.153296 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:16.154115 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:16.154555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:16.171936 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Getting quotas for project c54669eadc784d4aac5d1a40d18858b1. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:37:16.176493 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Getting quotas for user 0b01be56426e4ff1a09577f30fb79f0b and project c54669eadc784d4aac5d1a40d18858b1. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:37:16.188041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:37:16.190858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:37:16.235742 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-24088a11-96be-41d6-bddf-e2cccd47e9be tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.609427 May 12 09:37:16.237129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 237/486] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:37:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:37:16.247632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-559c670b-153e-42af-8b05-e98f044ea857 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:16.248493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-559c670b-153e-42af-8b05-e98f044ea857 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:16.305584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-559c670b-153e-42af-8b05-e98f044ea857 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:16.312148 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-559c670b-153e-42af-8b05-e98f044ea857 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1245 microversion: 2.1 time: 0.068980 May 12 09:37:16.312702 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 250/487] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:16 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:17.329849 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-100c72d9-a3cb-441f-91fe-ba7db2034a75 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:17.331107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-100c72d9-a3cb-441f-91fe-ba7db2034a75 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:17.381729 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-100c72d9-a3cb-441f-91fe-ba7db2034a75 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:17.388388 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-100c72d9-a3cb-441f-91fe-ba7db2034a75 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1245 microversion: 2.1 time: 0.063133 May 12 09:37:17.388981 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 238/488] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:17 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1245 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:18.405479 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e8f87df8-991d-4808-9b3e-50c4afaba59b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:18.406125 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e8f87df8-991d-4808-9b3e-50c4afaba59b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:18.458926 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e8f87df8-991d-4808-9b3e-50c4afaba59b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:18.465820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e8f87df8-991d-4808-9b3e-50c4afaba59b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1245 microversion: 2.1 time: 0.064020 May 12 09:37:18.466439 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 251/489] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:18 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1245 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:37:19.487203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-419ef8bd-f919-4dd1-a753-8c6438c3d44f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:19.487845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-419ef8bd-f919-4dd1-a753-8c6438c3d44f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:19.494689 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-419ef8bd-f919-4dd1-a753-8c6438c3d44f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:19.495137 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-419ef8bd-f919-4dd1-a753-8c6438c3d44f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:19.495891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-419ef8bd-f919-4dd1-a753-8c6438c3d44f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:19.496323 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-419ef8bd-f919-4dd1-a753-8c6438c3d44f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:19.557260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-419ef8bd-f919-4dd1-a753-8c6438c3d44f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:19.564019 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-419ef8bd-f919-4dd1-a753-8c6438c3d44f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1249 microversion: 2.1 time: 0.080742 May 12 09:37:19.564626 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 239/490] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:19 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:20.580643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4140a939-160b-47d0-8df5-791d2011586a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:20.581334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4140a939-160b-47d0-8df5-791d2011586a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:20.588031 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4140a939-160b-47d0-8df5-791d2011586a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:20.588499 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4140a939-160b-47d0-8df5-791d2011586a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:20.589318 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4140a939-160b-47d0-8df5-791d2011586a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:20.589797 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4140a939-160b-47d0-8df5-791d2011586a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:20.659211 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4140a939-160b-47d0-8df5-791d2011586a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:20.666453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4140a939-160b-47d0-8df5-791d2011586a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1297 microversion: 2.1 time: 0.089752 May 12 09:37:20.667010 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 252/491] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:20 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:21.684343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-58a443b2-b233-441f-ae78-77ece6a24dfa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:21.685016 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-58a443b2-b233-441f-ae78-77ece6a24dfa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:21.691629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-58a443b2-b233-441f-ae78-77ece6a24dfa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:21.692079 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-58a443b2-b233-441f-ae78-77ece6a24dfa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:21.692861 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-58a443b2-b233-441f-ae78-77ece6a24dfa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:21.693300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-58a443b2-b233-441f-ae78-77ece6a24dfa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:21.757075 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-58a443b2-b233-441f-ae78-77ece6a24dfa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:21.765843 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-58a443b2-b233-441f-ae78-77ece6a24dfa tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1303 microversion: 2.1 time: 0.085432 May 12 09:37:21.766887 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 240/492] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:21 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:22.777998 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-b7a14fd3-f3ff-480b-b830-125aa08d0078 req-9366b1b5-0309-4db0-a9b6-3fc7b8455c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7801a053-99b6-4a9b-9962-1620c14aac30", "tag": "475e0f9c-a9a4-469d-8d8e-9e0f42721e10"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:22.785186 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f00cc8a6-2138-4b28-a5ca-c01d98f7d9b7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:22.786372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-b7a14fd3-f3ff-480b-b830-125aa08d0078 req-9366b1b5-0309-4db0-a9b6-3fc7b8455c80 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:22.786817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-b7a14fd3-f3ff-480b-b830-125aa08d0078 req-9366b1b5-0309-4db0-a9b6-3fc7b8455c80 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:22.789106 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f00cc8a6-2138-4b28-a5ca-c01d98f7d9b7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:22.795663 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f00cc8a6-2138-4b28-a5ca-c01d98f7d9b7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:22.801265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f00cc8a6-2138-4b28-a5ca-c01d98f7d9b7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:22.802204 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f00cc8a6-2138-4b28-a5ca-c01d98f7d9b7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:22.802722 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f00cc8a6-2138-4b28-a5ca-c01d98f7d9b7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:22.804673 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-b7a14fd3-f3ff-480b-b830-125aa08d0078 req-9366b1b5-0309-4db0-a9b6-3fc7b8455c80 service nova] Creating event network-changed:475e0f9c-a9a4-469d-8d8e-9e0f42721e10 for instance 7801a053-99b6-4a9b-9962-1620c14aac30 on hv-cinder-83769 May 12 09:37:22.811685 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-b7a14fd3-f3ff-480b-b830-125aa08d0078 req-9366b1b5-0309-4db0-a9b6-3fc7b8455c80 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040738 May 12 09:37:22.816106 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 253/493] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:37:22.963643 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f00cc8a6-2138-4b28-a5ca-c01d98f7d9b7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:22.971588 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f00cc8a6-2138-4b28-a5ca-c01d98f7d9b7 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.191207 May 12 09:37:22.972271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 241/494] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:22 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:23.005118 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:37:23.005297 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Thu May 12 09:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:37:23.989618 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e6e4f426-33f7-4d19-97f1-81c20043d08a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:23.990331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e6e4f426-33f7-4d19-97f1-81c20043d08a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:23.997653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e6e4f426-33f7-4d19-97f1-81c20043d08a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:23.998134 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e6e4f426-33f7-4d19-97f1-81c20043d08a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:23.998886 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e6e4f426-33f7-4d19-97f1-81c20043d08a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:23.999313 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e6e4f426-33f7-4d19-97f1-81c20043d08a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:24.130254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e6e4f426-33f7-4d19-97f1-81c20043d08a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:24.137647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e6e4f426-33f7-4d19-97f1-81c20043d08a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.152952 May 12 09:37:24.138232 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 254/495] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:23 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:25.154789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0fcd6386-5e74-4cb0-8ddd-44dc2e9b8b84 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:25.155394 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0fcd6386-5e74-4cb0-8ddd-44dc2e9b8b84 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:25.162276 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0fcd6386-5e74-4cb0-8ddd-44dc2e9b8b84 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:25.162728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0fcd6386-5e74-4cb0-8ddd-44dc2e9b8b84 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:25.163486 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0fcd6386-5e74-4cb0-8ddd-44dc2e9b8b84 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:25.163920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0fcd6386-5e74-4cb0-8ddd-44dc2e9b8b84 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:25.290022 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0fcd6386-5e74-4cb0-8ddd-44dc2e9b8b84 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:25.297127 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0fcd6386-5e74-4cb0-8ddd-44dc2e9b8b84 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.146156 May 12 09:37:25.297711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 242/496] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:25 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:26.313601 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-499cb3c5-5dcc-4f2e-a77a-c4dc79262f5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:26.314225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-499cb3c5-5dcc-4f2e-a77a-c4dc79262f5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:26.320529 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-499cb3c5-5dcc-4f2e-a77a-c4dc79262f5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:26.320975 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-499cb3c5-5dcc-4f2e-a77a-c4dc79262f5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:26.321731 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-499cb3c5-5dcc-4f2e-a77a-c4dc79262f5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:26.322198 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-499cb3c5-5dcc-4f2e-a77a-c4dc79262f5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:26.443936 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-499cb3c5-5dcc-4f2e-a77a-c4dc79262f5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:26.451111 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-499cb3c5-5dcc-4f2e-a77a-c4dc79262f5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.141275 May 12 09:37:26.451660 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 255/497] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:26 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:27.467464 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-fe5145ef-1dfd-4255-9bfe-58fee33d35d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:27.468072 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-fe5145ef-1dfd-4255-9bfe-58fee33d35d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:27.474848 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fe5145ef-1dfd-4255-9bfe-58fee33d35d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:27.475294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fe5145ef-1dfd-4255-9bfe-58fee33d35d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:27.476055 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fe5145ef-1dfd-4255-9bfe-58fee33d35d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:27.476484 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fe5145ef-1dfd-4255-9bfe-58fee33d35d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:27.605419 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-fe5145ef-1dfd-4255-9bfe-58fee33d35d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:27.612634 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-fe5145ef-1dfd-4255-9bfe-58fee33d35d2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.149049 May 12 09:37:27.613410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 243/498] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:27 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:28.630349 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ac5bc4bf-a403-4fe0-b926-a2ff92187b14 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:28.630935 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ac5bc4bf-a403-4fe0-b926-a2ff92187b14 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:28.637403 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ac5bc4bf-a403-4fe0-b926-a2ff92187b14 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:28.637864 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ac5bc4bf-a403-4fe0-b926-a2ff92187b14 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:28.638641 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ac5bc4bf-a403-4fe0-b926-a2ff92187b14 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:28.639069 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ac5bc4bf-a403-4fe0-b926-a2ff92187b14 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:28.764342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ac5bc4bf-a403-4fe0-b926-a2ff92187b14 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:28.771546 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ac5bc4bf-a403-4fe0-b926-a2ff92187b14 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.145520 May 12 09:37:28.772186 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 256/499] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:28 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:37:29.788988 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-15c33ada-4793-4d49-93b8-380c030a7bfe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:29.789601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-15c33ada-4793-4d49-93b8-380c030a7bfe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:29.796120 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-15c33ada-4793-4d49-93b8-380c030a7bfe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:29.796572 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-15c33ada-4793-4d49-93b8-380c030a7bfe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:29.797349 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-15c33ada-4793-4d49-93b8-380c030a7bfe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:29.797785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-15c33ada-4793-4d49-93b8-380c030a7bfe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:29.944469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-15c33ada-4793-4d49-93b8-380c030a7bfe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:29.951734 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-15c33ada-4793-4d49-93b8-380c030a7bfe tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.166625 May 12 09:37:29.952294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 244/500] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:29 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:30.969703 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8fbbd3a0-cd15-49af-b2d2-dc99c84c53e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:30.970309 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8fbbd3a0-cd15-49af-b2d2-dc99c84c53e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:30.977575 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8fbbd3a0-cd15-49af-b2d2-dc99c84c53e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:30.978048 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8fbbd3a0-cd15-49af-b2d2-dc99c84c53e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:30.978807 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8fbbd3a0-cd15-49af-b2d2-dc99c84c53e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:30.979238 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8fbbd3a0-cd15-49af-b2d2-dc99c84c53e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:31.110531 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8fbbd3a0-cd15-49af-b2d2-dc99c84c53e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:31.117822 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8fbbd3a0-cd15-49af-b2d2-dc99c84c53e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.152398 May 12 09:37:31.118422 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 257/501] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:30 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:32.135764 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5e1398c6-fdbf-4b59-9858-ca0bac4e658d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:32.136471 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5e1398c6-fdbf-4b59-9858-ca0bac4e658d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:32.143576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5e1398c6-fdbf-4b59-9858-ca0bac4e658d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:32.144023 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5e1398c6-fdbf-4b59-9858-ca0bac4e658d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:32.144779 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5e1398c6-fdbf-4b59-9858-ca0bac4e658d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:32.145209 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5e1398c6-fdbf-4b59-9858-ca0bac4e658d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:32.275298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5e1398c6-fdbf-4b59-9858-ca0bac4e658d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:32.282389 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5e1398c6-fdbf-4b59-9858-ca0bac4e658d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.152226 May 12 09:37:32.283668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 245/502] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:32 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:33.300089 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ecc4e3d2-a4ed-412e-a647-64af5ee0d8ee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:33.300697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ecc4e3d2-a4ed-412e-a647-64af5ee0d8ee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:33.307033 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ecc4e3d2-a4ed-412e-a647-64af5ee0d8ee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:33.307486 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ecc4e3d2-a4ed-412e-a647-64af5ee0d8ee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:33.308249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ecc4e3d2-a4ed-412e-a647-64af5ee0d8ee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:33.308687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ecc4e3d2-a4ed-412e-a647-64af5ee0d8ee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:33.435350 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ecc4e3d2-a4ed-412e-a647-64af5ee0d8ee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:33.442498 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ecc4e3d2-a4ed-412e-a647-64af5ee0d8ee tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.146373 May 12 09:37:33.443049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 258/503] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:33 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:34.459917 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0689b0d4-1337-4959-87d6-4e0bfd5dadd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:34.460519 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0689b0d4-1337-4959-87d6-4e0bfd5dadd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:34.466873 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0689b0d4-1337-4959-87d6-4e0bfd5dadd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:34.467317 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0689b0d4-1337-4959-87d6-4e0bfd5dadd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:34.468069 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0689b0d4-1337-4959-87d6-4e0bfd5dadd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:34.468497 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0689b0d4-1337-4959-87d6-4e0bfd5dadd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:34.592674 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0689b0d4-1337-4959-87d6-4e0bfd5dadd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:34.599853 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0689b0d4-1337-4959-87d6-4e0bfd5dadd5 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.144309 May 12 09:37:34.600348 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 246/504] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:34 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:35.616715 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f5914c8c-2452-413f-9e23-9da5a2972e71 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:35.617359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f5914c8c-2452-413f-9e23-9da5a2972e71 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:35.623687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f5914c8c-2452-413f-9e23-9da5a2972e71 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:35.624137 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f5914c8c-2452-413f-9e23-9da5a2972e71 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:35.624904 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f5914c8c-2452-413f-9e23-9da5a2972e71 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:35.625345 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f5914c8c-2452-413f-9e23-9da5a2972e71 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:35.757254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f5914c8c-2452-413f-9e23-9da5a2972e71 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:35.764643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f5914c8c-2452-413f-9e23-9da5a2972e71 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.151733 May 12 09:37:35.765213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 259/505] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:35 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:36.781235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-389f0534-7ae0-439f-936b-d3f71d52ac49 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:36.781836 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-389f0534-7ae0-439f-936b-d3f71d52ac49 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:36.788166 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-389f0534-7ae0-439f-936b-d3f71d52ac49 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:36.788609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-389f0534-7ae0-439f-936b-d3f71d52ac49 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:36.789421 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-389f0534-7ae0-439f-936b-d3f71d52ac49 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:36.789878 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-389f0534-7ae0-439f-936b-d3f71d52ac49 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:36.919627 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-389f0534-7ae0-439f-936b-d3f71d52ac49 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:36.927266 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-389f0534-7ae0-439f-936b-d3f71d52ac49 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.149888 May 12 09:37:36.927819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 247/506] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:36 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:37.944074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-25583622-fca8-407f-9a3e-b587058a2d5c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:37.944613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-25583622-fca8-407f-9a3e-b587058a2d5c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:37.950917 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-25583622-fca8-407f-9a3e-b587058a2d5c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:37.951371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-25583622-fca8-407f-9a3e-b587058a2d5c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:37.952134 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-25583622-fca8-407f-9a3e-b587058a2d5c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:37.952574 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-25583622-fca8-407f-9a3e-b587058a2d5c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:38.077658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-25583622-fca8-407f-9a3e-b587058a2d5c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:38.085412 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-25583622-fca8-407f-9a3e-b587058a2d5c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.145262 May 12 09:37:38.085990 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 260/507] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:37 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:39.102652 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b652b207-f9b5-434e-95f5-4eef59b4ef23 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:39.103264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b652b207-f9b5-434e-95f5-4eef59b4ef23 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:39.109538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b652b207-f9b5-434e-95f5-4eef59b4ef23 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:39.110022 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b652b207-f9b5-434e-95f5-4eef59b4ef23 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:39.110789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b652b207-f9b5-434e-95f5-4eef59b4ef23 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:39.111269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b652b207-f9b5-434e-95f5-4eef59b4ef23 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:39.232786 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b652b207-f9b5-434e-95f5-4eef59b4ef23 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:39.239891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b652b207-f9b5-434e-95f5-4eef59b4ef23 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.141070 May 12 09:37:39.240459 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 248/508] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:39 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:40.257658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-015ca323-03b1-47c7-b99e-66a69c3e290e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:40.258273 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-015ca323-03b1-47c7-b99e-66a69c3e290e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:40.264415 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-015ca323-03b1-47c7-b99e-66a69c3e290e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:40.264862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-015ca323-03b1-47c7-b99e-66a69c3e290e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:40.265623 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-015ca323-03b1-47c7-b99e-66a69c3e290e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:40.266092 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-015ca323-03b1-47c7-b99e-66a69c3e290e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:40.391535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-015ca323-03b1-47c7-b99e-66a69c3e290e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:40.399266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-015ca323-03b1-47c7-b99e-66a69c3e290e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.145652 May 12 09:37:40.399825 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 261/509] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:40 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:41.416120 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6f553050-ef63-45ea-ac1f-22293c40817d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:41.416632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6f553050-ef63-45ea-ac1f-22293c40817d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:41.422962 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f553050-ef63-45ea-ac1f-22293c40817d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:41.423409 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f553050-ef63-45ea-ac1f-22293c40817d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:41.424162 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f553050-ef63-45ea-ac1f-22293c40817d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:41.424593 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f553050-ef63-45ea-ac1f-22293c40817d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:41.548891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6f553050-ef63-45ea-ac1f-22293c40817d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:41.556130 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6f553050-ef63-45ea-ac1f-22293c40817d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.143887 May 12 09:37:41.556686 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 249/510] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:41 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:42.572813 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c9ce28ae-2917-4df5-b060-53532ac3bb5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:42.573410 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c9ce28ae-2917-4df5-b060-53532ac3bb5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:42.579683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9ce28ae-2917-4df5-b060-53532ac3bb5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:42.580129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9ce28ae-2917-4df5-b060-53532ac3bb5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:42.580879 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9ce28ae-2917-4df5-b060-53532ac3bb5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:42.581323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9ce28ae-2917-4df5-b060-53532ac3bb5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:42.706912 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c9ce28ae-2917-4df5-b060-53532ac3bb5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:42.714328 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c9ce28ae-2917-4df5-b060-53532ac3bb5d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.145314 May 12 09:37:42.714899 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 262/511] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:42 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:42.881910 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-155989683", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "networks": [{"uuid": "1c036158-1d81-400b-8003-63be31daecc9"}]}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:42.935463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] validate_networks() for [('1c036158-1d81-400b-8003-63be31daecc9', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:37:43.265301 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:37:43.265718 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:37:43.266215 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:37:43.266619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:37:43.267020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:37:43.275836 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:43.276273 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:43.277061 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:43.277487 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:43.292963 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Getting quotas for project 59546c2ca0074bb5b77b7c5e64d9c068. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:37:43.296549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Getting quotas for user 7dd6d3e1b6ea49d4a75e5f7e105ea0f0 and project 59546c2ca0074bb5b77b7c5e64d9c068. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:37:43.307054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:37:43.309104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:37:43.353363 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e5a6eff6-5337-4e3d-b1c8-f85708f22178 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475388 May 12 09:37:43.354233 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 250/512] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:37:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:37:43.363764 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6b84658e-b010-48ce-9d35-c9a049a53b93 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:43.364375 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6b84658e-b010-48ce-9d35-c9a049a53b93 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:43.420222 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6b84658e-b010-48ce-9d35-c9a049a53b93 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:43.427529 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6b84658e-b010-48ce-9d35-c9a049a53b93 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1218 microversion: 2.1 time: 0.067493 May 12 09:37:43.428226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 263/513] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:43 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:43.730860 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-dd0010b5-b47b-4e07-97ae-5283eb2ffabc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:43.731470 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-dd0010b5-b47b-4e07-97ae-5283eb2ffabc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:43.737905 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dd0010b5-b47b-4e07-97ae-5283eb2ffabc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:43.738373 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dd0010b5-b47b-4e07-97ae-5283eb2ffabc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:43.739142 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dd0010b5-b47b-4e07-97ae-5283eb2ffabc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:43.739584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dd0010b5-b47b-4e07-97ae-5283eb2ffabc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:43.878778 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-dd0010b5-b47b-4e07-97ae-5283eb2ffabc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:43.886381 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-dd0010b5-b47b-4e07-97ae-5283eb2ffabc tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.159386 May 12 09:37:43.887175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 251/514] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:43 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:44.444647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f7ee2221-c119-4a1a-b22d-e1a937a64d96 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:44.445239 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f7ee2221-c119-4a1a-b22d-e1a937a64d96 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:44.451395 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f7ee2221-c119-4a1a-b22d-e1a937a64d96 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:44.451839 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f7ee2221-c119-4a1a-b22d-e1a937a64d96 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:44.452593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f7ee2221-c119-4a1a-b22d-e1a937a64d96 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:44.453024 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f7ee2221-c119-4a1a-b22d-e1a937a64d96 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:44.514646 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f7ee2221-c119-4a1a-b22d-e1a937a64d96 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:44.521843 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f7ee2221-c119-4a1a-b22d-e1a937a64d96 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1222 microversion: 2.1 time: 0.081076 May 12 09:37:44.522436 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 264/515] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:44 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:44.902864 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6771c86d-058e-4606-a3ab-aeabe3918381 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:44.903474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6771c86d-058e-4606-a3ab-aeabe3918381 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:44.910303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6771c86d-058e-4606-a3ab-aeabe3918381 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:44.910756 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6771c86d-058e-4606-a3ab-aeabe3918381 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:44.911518 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6771c86d-058e-4606-a3ab-aeabe3918381 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:44.911953 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6771c86d-058e-4606-a3ab-aeabe3918381 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:45.043980 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6771c86d-058e-4606-a3ab-aeabe3918381 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:45.052527 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6771c86d-058e-4606-a3ab-aeabe3918381 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.153363 May 12 09:37:45.053353 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 252/516] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:44 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:45.538687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7cdf6198-b6b2-46f2-8c87-2e85e85c4b6b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:45.539303 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7cdf6198-b6b2-46f2-8c87-2e85e85c4b6b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:45.546079 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7cdf6198-b6b2-46f2-8c87-2e85e85c4b6b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:45.546540 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7cdf6198-b6b2-46f2-8c87-2e85e85c4b6b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:45.547310 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7cdf6198-b6b2-46f2-8c87-2e85e85c4b6b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:45.547750 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7cdf6198-b6b2-46f2-8c87-2e85e85c4b6b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:45.607889 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7cdf6198-b6b2-46f2-8c87-2e85e85c4b6b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:45.614977 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7cdf6198-b6b2-46f2-8c87-2e85e85c4b6b tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1270 microversion: 2.1 time: 0.080194 May 12 09:37:45.615534 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 265/517] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:45 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:46.071315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-72fb20cb-4133-4376-80ab-9e87bfe6f763 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:46.071770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-72fb20cb-4133-4376-80ab-9e87bfe6f763 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:46.079077 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-72fb20cb-4133-4376-80ab-9e87bfe6f763 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:46.079419 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-72fb20cb-4133-4376-80ab-9e87bfe6f763 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:46.084382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-72fb20cb-4133-4376-80ab-9e87bfe6f763 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:46.084832 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-72fb20cb-4133-4376-80ab-9e87bfe6f763 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:46.358546 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-ffa127e8-ce92-401f-939a-6ce0cccf9288 req-5575fcd8-a4c9-4c16-8ad3-cc3f594d7dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7801a053-99b6-4a9b-9962-1620c14aac30", "name": "network-vif-plugged", "status": "completed", "tag": "475e0f9c-a9a4-469d-8d8e-9e0f42721e10"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:46.370134 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-ffa127e8-ce92-401f-939a-6ce0cccf9288 req-5575fcd8-a4c9-4c16-8ad3-cc3f594d7dff service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:46.370856 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-ffa127e8-ce92-401f-939a-6ce0cccf9288 req-5575fcd8-a4c9-4c16-8ad3-cc3f594d7dff service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:46.387999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-ffa127e8-ce92-401f-939a-6ce0cccf9288 req-5575fcd8-a4c9-4c16-8ad3-cc3f594d7dff service nova] Creating event network-vif-plugged:475e0f9c-a9a4-469d-8d8e-9e0f42721e10 for instance 7801a053-99b6-4a9b-9962-1620c14aac30 on hv-cinder-83769 May 12 09:37:46.395060 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-ffa127e8-ce92-401f-939a-6ce0cccf9288 req-5575fcd8-a4c9-4c16-8ad3-cc3f594d7dff service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045401 May 12 09:37:46.395988 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 266/518] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:37:46.444863 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-72fb20cb-4133-4376-80ab-9e87bfe6f763 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:46.459292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-72fb20cb-4133-4376-80ab-9e87bfe6f763 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.393055 May 12 09:37:46.459889 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 253/519] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:46 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:46.634079 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-23a5d6dd-d279-4cfa-a9df-51da42ec7f8c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:46.635529 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-23a5d6dd-d279-4cfa-a9df-51da42ec7f8c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:46.647541 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-23a5d6dd-d279-4cfa-a9df-51da42ec7f8c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:46.650548 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-23a5d6dd-d279-4cfa-a9df-51da42ec7f8c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:46.651270 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-23a5d6dd-d279-4cfa-a9df-51da42ec7f8c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:46.651728 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-23a5d6dd-d279-4cfa-a9df-51da42ec7f8c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:46.756083 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-23a5d6dd-d279-4cfa-a9df-51da42ec7f8c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:46.767944 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-23a5d6dd-d279-4cfa-a9df-51da42ec7f8c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1276 microversion: 2.1 time: 0.138317 May 12 09:37:46.768887 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 267/520] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:46 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:47.476500 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c2c87503-d5e5-49e1-a30e-0ff6ab8bb753 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:47.477128 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c2c87503-d5e5-49e1-a30e-0ff6ab8bb753 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:47.483397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2c87503-d5e5-49e1-a30e-0ff6ab8bb753 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:47.483843 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2c87503-d5e5-49e1-a30e-0ff6ab8bb753 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:47.484596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2c87503-d5e5-49e1-a30e-0ff6ab8bb753 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:47.485026 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2c87503-d5e5-49e1-a30e-0ff6ab8bb753 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:47.787355 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f0dff892-ea9b-407b-9c0c-71761b31f816 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:47.788286 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f0dff892-ea9b-407b-9c0c-71761b31f816 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:47.795269 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f0dff892-ea9b-407b-9c0c-71761b31f816 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:47.795720 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f0dff892-ea9b-407b-9c0c-71761b31f816 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:47.796754 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f0dff892-ea9b-407b-9c0c-71761b31f816 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:47.797385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f0dff892-ea9b-407b-9c0c-71761b31f816 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:47.866993 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c2c87503-d5e5-49e1-a30e-0ff6ab8bb753 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:47.875792 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c2c87503-d5e5-49e1-a30e-0ff6ab8bb753 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.403020 May 12 09:37:47.876458 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 254/521] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:47 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:48.009461 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f0dff892-ea9b-407b-9c0c-71761b31f816 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:48.017791 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f0dff892-ea9b-407b-9c0c-71761b31f816 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.235177 May 12 09:37:48.018880 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 268/522] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:47 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:37:48.545954 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-22515fd7-1f01-41a5-866a-5587563274de req-08ae1e75-8845-469f-bf17-7c062c803a8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28f509a-6478-4c54-b6a2-18006ba9b4e4", "tag": "8acbd1cf-7e16-4732-87ec-d4881219909c"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:48.554214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-22515fd7-1f01-41a5-866a-5587563274de req-08ae1e75-8845-469f-bf17-7c062c803a8d service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:48.554657 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-22515fd7-1f01-41a5-866a-5587563274de req-08ae1e75-8845-469f-bf17-7c062c803a8d service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:48.567369 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-22515fd7-1f01-41a5-866a-5587563274de req-08ae1e75-8845-469f-bf17-7c062c803a8d service nova] Creating event network-changed:8acbd1cf-7e16-4732-87ec-d4881219909c for instance b28f509a-6478-4c54-b6a2-18006ba9b4e4 on hv-cinder-83769 May 12 09:37:48.572474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-22515fd7-1f01-41a5-866a-5587563274de req-08ae1e75-8845-469f-bf17-7c062c803a8d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030207 May 12 09:37:48.573066 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 255/523] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:37:48.892972 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b8a292a6-f14f-4729-bc7e-8284aabc482a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:48.893570 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b8a292a6-f14f-4729-bc7e-8284aabc482a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:48.899858 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8a292a6-f14f-4729-bc7e-8284aabc482a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:48.900384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8a292a6-f14f-4729-bc7e-8284aabc482a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:48.901038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8a292a6-f14f-4729-bc7e-8284aabc482a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:48.901470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8a292a6-f14f-4729-bc7e-8284aabc482a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:49.036169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e171902b-89ce-4711-9902-0a9d19c4f5d8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:49.036875 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e171902b-89ce-4711-9902-0a9d19c4f5d8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:49.039838 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b8a292a6-f14f-4729-bc7e-8284aabc482a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:49.043233 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e171902b-89ce-4711-9902-0a9d19c4f5d8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:49.043738 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e171902b-89ce-4711-9902-0a9d19c4f5d8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:49.044456 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e171902b-89ce-4711-9902-0a9d19c4f5d8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:49.044898 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e171902b-89ce-4711-9902-0a9d19c4f5d8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:49.047089 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b8a292a6-f14f-4729-bc7e-8284aabc482a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1370 microversion: 2.1 time: 0.158609 May 12 09:37:49.048383 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 269/524] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:48 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:49.195140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e171902b-89ce-4711-9902-0a9d19c4f5d8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:49.206953 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e171902b-89ce-4711-9902-0a9d19c4f5d8 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.175429 May 12 09:37:49.207630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 256/525] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:49 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:37:50.063606 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e0ce8fa8-42d1-4d56-9604-04f02ec6fb32 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:50.064866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e0ce8fa8-42d1-4d56-9604-04f02ec6fb32 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:50.071567 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0ce8fa8-42d1-4d56-9604-04f02ec6fb32 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:50.072423 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0ce8fa8-42d1-4d56-9604-04f02ec6fb32 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:50.073759 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0ce8fa8-42d1-4d56-9604-04f02ec6fb32 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:50.074505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0ce8fa8-42d1-4d56-9604-04f02ec6fb32 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:50.210633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e0ce8fa8-42d1-4d56-9604-04f02ec6fb32 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:50.218948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e0ce8fa8-42d1-4d56-9604-04f02ec6fb32 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1564 microversion: 2.1 time: 0.158308 May 12 09:37:50.219552 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 270/526] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:50 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:50.224711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-242cb390-e873-4454-a3ce-6e7d9622e37c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:50.225325 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-242cb390-e873-4454-a3ce-6e7d9622e37c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:50.231895 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-242cb390-e873-4454-a3ce-6e7d9622e37c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:50.232407 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-242cb390-e873-4454-a3ce-6e7d9622e37c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:50.233182 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-242cb390-e873-4454-a3ce-6e7d9622e37c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:50.233628 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-242cb390-e873-4454-a3ce-6e7d9622e37c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:50.234354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ab6724b6-64c0-4da4-85c8-1b4436559d26 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:50.234870 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ab6724b6-64c0-4da4-85c8-1b4436559d26 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:50.240776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab6724b6-64c0-4da4-85c8-1b4436559d26 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:50.241202 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab6724b6-64c0-4da4-85c8-1b4436559d26 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:50.241985 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab6724b6-64c0-4da4-85c8-1b4436559d26 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:50.242419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ab6724b6-64c0-4da4-85c8-1b4436559d26 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:50.376108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ab6724b6-64c0-4da4-85c8-1b4436559d26 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145663 May 12 09:37:50.377370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 271/527] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 12 09:37:50 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:37:50.420835 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-242cb390-e873-4454-a3ce-6e7d9622e37c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:50.429703 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-242cb390-e873-4454-a3ce-6e7d9622e37c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.208780 May 12 09:37:50.430319 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 257/528] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:50 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:51.447341 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-58b881cd-ca92-4ae6-8c06-02dac9619097 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:51.448039 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-58b881cd-ca92-4ae6-8c06-02dac9619097 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:51.453889 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58b881cd-ca92-4ae6-8c06-02dac9619097 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:51.454480 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58b881cd-ca92-4ae6-8c06-02dac9619097 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:51.455934 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58b881cd-ca92-4ae6-8c06-02dac9619097 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:51.456375 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58b881cd-ca92-4ae6-8c06-02dac9619097 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:51.590160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-58b881cd-ca92-4ae6-8c06-02dac9619097 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:51.597344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-58b881cd-ca92-4ae6-8c06-02dac9619097 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.154445 May 12 09:37:51.597928 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 272/529] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:51 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:51.873934 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-9feb8eb8-7000-4c8f-b4ed-fcc34f81b067 req-22800979-a435-4adf-8f10-afd4f545c20b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7801a053-99b6-4a9b-9962-1620c14aac30", "tag": "475e0f9c-a9a4-469d-8d8e-9e0f42721e10"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:51.883105 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-9feb8eb8-7000-4c8f-b4ed-fcc34f81b067 req-22800979-a435-4adf-8f10-afd4f545c20b service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:51.883664 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-9feb8eb8-7000-4c8f-b4ed-fcc34f81b067 req-22800979-a435-4adf-8f10-afd4f545c20b service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:51.895055 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-9feb8eb8-7000-4c8f-b4ed-fcc34f81b067 req-22800979-a435-4adf-8f10-afd4f545c20b service nova] Creating event network-changed:475e0f9c-a9a4-469d-8d8e-9e0f42721e10 for instance 7801a053-99b6-4a9b-9962-1620c14aac30 on hv-cinder-83769 May 12 09:37:51.901257 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-9feb8eb8-7000-4c8f-b4ed-fcc34f81b067 req-22800979-a435-4adf-8f10-afd4f545c20b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030968 May 12 09:37:51.902896 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 258/530] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:37:52.614393 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-69b97f9b-fc55-43a7-899b-6e6d62e53343 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:52.615129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-69b97f9b-fc55-43a7-899b-6e6d62e53343 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:52.622172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69b97f9b-fc55-43a7-899b-6e6d62e53343 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:52.622825 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69b97f9b-fc55-43a7-899b-6e6d62e53343 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:52.623713 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69b97f9b-fc55-43a7-899b-6e6d62e53343 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:52.624217 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69b97f9b-fc55-43a7-899b-6e6d62e53343 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:52.770875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-69b97f9b-fc55-43a7-899b-6e6d62e53343 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:52.778578 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-69b97f9b-fc55-43a7-899b-6e6d62e53343 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.168833 May 12 09:37:52.779155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 273/531] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:52 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:53.797210 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c25bfdd4-c813-4433-8a9c-46fc60b59bf1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:53.797938 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c25bfdd4-c813-4433-8a9c-46fc60b59bf1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:53.804134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c25bfdd4-c813-4433-8a9c-46fc60b59bf1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:53.804577 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c25bfdd4-c813-4433-8a9c-46fc60b59bf1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:53.805328 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c25bfdd4-c813-4433-8a9c-46fc60b59bf1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:53.805756 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c25bfdd4-c813-4433-8a9c-46fc60b59bf1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:53.936814 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c25bfdd4-c813-4433-8a9c-46fc60b59bf1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:53.944209 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c25bfdd4-c813-4433-8a9c-46fc60b59bf1 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.151589 May 12 09:37:53.944775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 259/532] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:53 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:54.961135 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-13d47e3c-2281-440a-b5c1-0061264dd220 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:54.961759 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-13d47e3c-2281-440a-b5c1-0061264dd220 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:54.968681 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13d47e3c-2281-440a-b5c1-0061264dd220 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:54.969508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13d47e3c-2281-440a-b5c1-0061264dd220 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:54.971415 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13d47e3c-2281-440a-b5c1-0061264dd220 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:54.971998 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13d47e3c-2281-440a-b5c1-0061264dd220 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:55.102317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-13d47e3c-2281-440a-b5c1-0061264dd220 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:55.110322 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-13d47e3c-2281-440a-b5c1-0061264dd220 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.153018 May 12 09:37:55.111552 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 274/533] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:54 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:56.128395 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-19e037c9-2f27-406e-a96b-d5695998d84f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:56.129001 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-19e037c9-2f27-406e-a96b-d5695998d84f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:56.135608 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-19e037c9-2f27-406e-a96b-d5695998d84f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:56.136058 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-19e037c9-2f27-406e-a96b-d5695998d84f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:56.136824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-19e037c9-2f27-406e-a96b-d5695998d84f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:56.137259 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-19e037c9-2f27-406e-a96b-d5695998d84f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:56.271431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-19e037c9-2f27-406e-a96b-d5695998d84f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:56.279959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-19e037c9-2f27-406e-a96b-d5695998d84f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.155826 May 12 09:37:56.280576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 260/534] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:56 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:57.296495 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a99e44a5-edf3-4942-9932-55dfd4e36449 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:57.297104 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a99e44a5-edf3-4942-9932-55dfd4e36449 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:57.303456 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a99e44a5-edf3-4942-9932-55dfd4e36449 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:57.303907 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a99e44a5-edf3-4942-9932-55dfd4e36449 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:57.304665 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a99e44a5-edf3-4942-9932-55dfd4e36449 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:57.305097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a99e44a5-edf3-4942-9932-55dfd4e36449 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:57.443113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a99e44a5-edf3-4942-9932-55dfd4e36449 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:57.450450 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a99e44a5-edf3-4942-9932-55dfd4e36449 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.157790 May 12 09:37:57.451018 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 275/535] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:57 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:58.467822 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-989a598c-2961-471b-a52f-6182a434c28e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:58.468437 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-989a598c-2961-471b-a52f-6182a434c28e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:58.474934 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-989a598c-2961-471b-a52f-6182a434c28e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:58.475387 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-989a598c-2961-471b-a52f-6182a434c28e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:58.476151 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-989a598c-2961-471b-a52f-6182a434c28e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:58.476591 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-989a598c-2961-471b-a52f-6182a434c28e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:58.607647 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-989a598c-2961-471b-a52f-6182a434c28e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:58.615492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-989a598c-2961-471b-a52f-6182a434c28e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.151497 May 12 09:37:58.616071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 261/536] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:58 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:37:59.434750 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-a969fb39-be0a-41bd-ae56-a82bf07b3c04 req-baef0920-9625-419c-8186-f099cececff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28f509a-6478-4c54-b6a2-18006ba9b4e4", "name": "network-vif-plugged", "status": "completed", "tag": "8acbd1cf-7e16-4732-87ec-d4881219909c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:37:59.449172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-a969fb39-be0a-41bd-ae56-a82bf07b3c04 req-baef0920-9625-419c-8186-f099cececff6 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:59.449431 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-a969fb39-be0a-41bd-ae56-a82bf07b3c04 req-baef0920-9625-419c-8186-f099cececff6 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:59.460929 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-a969fb39-be0a-41bd-ae56-a82bf07b3c04 req-baef0920-9625-419c-8186-f099cececff6 service nova] Creating event network-vif-plugged:8acbd1cf-7e16-4732-87ec-d4881219909c for instance b28f509a-6478-4c54-b6a2-18006ba9b4e4 on hv-cinder-83769 May 12 09:37:59.465832 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-a969fb39-be0a-41bd-ae56-a82bf07b3c04 req-baef0920-9625-419c-8186-f099cececff6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034886 May 12 09:37:59.466628 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 276/537] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:37:59.634137 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-decc88b0-52bf-4e25-825f-5cf7b751b75c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:37:59.634766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-decc88b0-52bf-4e25-825f-5cf7b751b75c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:37:59.641816 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-decc88b0-52bf-4e25-825f-5cf7b751b75c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:59.642272 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-decc88b0-52bf-4e25-825f-5cf7b751b75c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:59.643085 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-decc88b0-52bf-4e25-825f-5cf7b751b75c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:37:59.643812 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-decc88b0-52bf-4e25-825f-5cf7b751b75c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:37:59.833816 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-decc88b0-52bf-4e25-825f-5cf7b751b75c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:37:59.840940 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-decc88b0-52bf-4e25-825f-5cf7b751b75c tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.211410 May 12 09:37:59.841493 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 262/538] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:37:59 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:38:00.859623 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-230ada49-b83a-4adc-b3c7-3bdb19366887 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:00.860317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-230ada49-b83a-4adc-b3c7-3bdb19366887 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:00.866575 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-230ada49-b83a-4adc-b3c7-3bdb19366887 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:00.867122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-230ada49-b83a-4adc-b3c7-3bdb19366887 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:00.867896 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-230ada49-b83a-4adc-b3c7-3bdb19366887 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:00.868330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-230ada49-b83a-4adc-b3c7-3bdb19366887 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:00.993639 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-230ada49-b83a-4adc-b3c7-3bdb19366887 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:38:01.001872 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-230ada49-b83a-4adc-b3c7-3bdb19366887 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.147064 May 12 09:38:01.003138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 277/539] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:38:00 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:38:02.020420 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5852fa40-5e4b-4d7d-bb2c-0fcbc2d7dd8e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:02.021057 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5852fa40-5e4b-4d7d-bb2c-0fcbc2d7dd8e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:02.028191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5852fa40-5e4b-4d7d-bb2c-0fcbc2d7dd8e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:02.028646 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5852fa40-5e4b-4d7d-bb2c-0fcbc2d7dd8e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:02.029470 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5852fa40-5e4b-4d7d-bb2c-0fcbc2d7dd8e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:02.029923 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5852fa40-5e4b-4d7d-bb2c-0fcbc2d7dd8e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:02.158584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5852fa40-5e4b-4d7d-bb2c-0fcbc2d7dd8e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:38:02.165781 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5852fa40-5e4b-4d7d-bb2c-0fcbc2d7dd8e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1318 microversion: 2.1 time: 0.150050 May 12 09:38:02.166363 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 263/540] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:38:02 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:38:03.182580 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e08b9850-b291-4cb8-ab42-109382d4590f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:03.184036 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e08b9850-b291-4cb8-ab42-109382d4590f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:03.189370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e08b9850-b291-4cb8-ab42-109382d4590f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:03.189809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e08b9850-b291-4cb8-ab42-109382d4590f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:03.190583 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e08b9850-b291-4cb8-ab42-109382d4590f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:03.191014 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e08b9850-b291-4cb8-ab42-109382d4590f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:03.331589 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e08b9850-b291-4cb8-ab42-109382d4590f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:38:03.339071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e08b9850-b291-4cb8-ab42-109382d4590f tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1507 microversion: 2.1 time: 0.160656 May 12 09:38:03.339629 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 278/541] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:38:03 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:38:03.355650 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7d44665e-697b-412d-8b20-5a6fdb6a9606 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db696792-6817-404a-8e3c-9f37182b5ca1", "device": "/dev/sdb"}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:38:03.357138 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7d44665e-697b-412d-8b20-5a6fdb6a9606 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:03.363332 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d44665e-697b-412d-8b20-5a6fdb6a9606 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:03.363776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d44665e-697b-412d-8b20-5a6fdb6a9606 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:03.364520 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d44665e-697b-412d-8b20-5a6fdb6a9606 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:03.364948 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d44665e-697b-412d-8b20-5a6fdb6a9606 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:03.628533 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7d44665e-697b-412d-8b20-5a6fdb6a9606 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "POST /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276531 May 12 09:38:03.632017 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 264/542] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:38:03 2022] POST /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:38:22.586004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-096018f0-1db7-466d-a421-0f46eb90a18d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:38:22.587308 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-096018f0-1db7-466d-a421-0f46eb90a18d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:22.593971 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-096018f0-1db7-466d-a421-0f46eb90a18d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:22.594734 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-096018f0-1db7-466d-a421-0f46eb90a18d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:22.595588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-096018f0-1db7-466d-a421-0f46eb90a18d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:22.596019 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-096018f0-1db7-466d-a421-0f46eb90a18d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:23.647828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-096018f0-1db7-466d-a421-0f46eb90a18d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action" status: 200 len: 28594 microversion: 2.1 time: 1.065549 May 12 09:38:23.648490 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 279/543] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:38:22 2022] POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action => generated 28594 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:38:28.906861 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5ed0a3e3-04b8-45f5-81af-f1b502fb7ef1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:38:28.907912 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5ed0a3e3-04b8-45f5-81af-f1b502fb7ef1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:28.914020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5ed0a3e3-04b8-45f5-81af-f1b502fb7ef1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:28.914470 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5ed0a3e3-04b8-45f5-81af-f1b502fb7ef1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:28.915231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5ed0a3e3-04b8-45f5-81af-f1b502fb7ef1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:28.915665 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5ed0a3e3-04b8-45f5-81af-f1b502fb7ef1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:31.812800 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5ed0a3e3-04b8-45f5-81af-f1b502fb7ef1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/action" status: 200 len: 28709 microversion: 2.1 time: 2.910384 May 12 09:38:31.813492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 265/544] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:38:28 2022] POST /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/action => generated 28709 bytes in 2912 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:38:37.256653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5f1aaf06-f97d-4b5f-993e-a4cd4c4a4b38 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:37.257226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5f1aaf06-f97d-4b5f-993e-a4cd4c4a4b38 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:37.264388 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f1aaf06-f97d-4b5f-993e-a4cd4c4a4b38 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:37.264886 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f1aaf06-f97d-4b5f-993e-a4cd4c4a4b38 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:37.265685 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f1aaf06-f97d-4b5f-993e-a4cd4c4a4b38 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:37.266149 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f1aaf06-f97d-4b5f-993e-a4cd4c4a4b38 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:37.386453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-5f1aaf06-f97d-4b5f-993e-a4cd4c4a4b38 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lazy-loading 'services' on Instance uuid b28f509a-6478-4c54-b6a2-18006ba9b4e4 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:38:37.500888 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5f1aaf06-f97d-4b5f-993e-a4cd4c4a4b38 tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4/os-volume_attachments/db696792-6817-404a-8e3c-9f37182b5ca1" status: 202 len: 0 microversion: 2.1 time: 0.248704 May 12 09:38:37.501414 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 280/545] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:38:37 2022] DELETE /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4/os-volume_attachments/db696792-6817-404a-8e3c-9f37182b5ca1 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:38:39.662622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4276847f-8dc2-44c1-8559-7fdfc183ea0d tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:39.663230 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4276847f-8dc2-44c1-8559-7fdfc183ea0d tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:39.670019 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4276847f-8dc2-44c1-8559-7fdfc183ea0d tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:39.670465 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4276847f-8dc2-44c1-8559-7fdfc183ea0d tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:39.671298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4276847f-8dc2-44c1-8559-7fdfc183ea0d tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:39.671831 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4276847f-8dc2-44c1-8559-7fdfc183ea0d tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:39.696220 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4276847f-8dc2-44c1-8559-7fdfc183ea0d tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Going to try to terminate instance {{(pid=123509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:38:39.776809 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4276847f-8dc2-44c1-8559-7fdfc183ea0d tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 204 len: 0 microversion: 2.1 time: 0.118494 May 12 09:38:39.777294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 266/546] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:38:39 2022] DELETE /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:38:39.786865 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4af1696e-c0e8-4905-82d4-aa4bdbab79ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:39.787561 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4af1696e-c0e8-4905-82d4-aa4bdbab79ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:39.793557 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4af1696e-c0e8-4905-82d4-aa4bdbab79ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:39.794043 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4af1696e-c0e8-4905-82d4-aa4bdbab79ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:39.794804 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4af1696e-c0e8-4905-82d4-aa4bdbab79ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:39.795242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4af1696e-c0e8-4905-82d4-aa4bdbab79ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:39.920099 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4af1696e-c0e8-4905-82d4-aa4bdbab79ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:38:39.927505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4af1696e-c0e8-4905-82d4-aa4bdbab79ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1513 microversion: 2.1 time: 0.145789 May 12 09:38:39.928071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 281/547] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:38:39 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:38:40.946236 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c8dd9ee4-4265-43f9-918d-f00a9ec6693e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:40.946843 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c8dd9ee4-4265-43f9-918d-f00a9ec6693e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:40.953106 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8dd9ee4-4265-43f9-918d-f00a9ec6693e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:40.953549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8dd9ee4-4265-43f9-918d-f00a9ec6693e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:40.954336 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8dd9ee4-4265-43f9-918d-f00a9ec6693e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:40.954818 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8dd9ee4-4265-43f9-918d-f00a9ec6693e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:41.089713 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c8dd9ee4-4265-43f9-918d-f00a9ec6693e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:38:41.097638 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c8dd9ee4-4265-43f9-918d-f00a9ec6693e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1513 microversion: 2.1 time: 0.155759 May 12 09:38:41.098264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 267/548] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:38:40 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:38:42.115363 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-07b6abfc-8229-43ae-8592-a82e54c9040e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:42.115963 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-07b6abfc-8229-43ae-8592-a82e54c9040e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:42.122203 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-07b6abfc-8229-43ae-8592-a82e54c9040e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:42.122646 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-07b6abfc-8229-43ae-8592-a82e54c9040e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:42.123398 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-07b6abfc-8229-43ae-8592-a82e54c9040e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:42.123833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-07b6abfc-8229-43ae-8592-a82e54c9040e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:42.250788 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-07b6abfc-8229-43ae-8592-a82e54c9040e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:38:42.259220 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-07b6abfc-8229-43ae-8592-a82e54c9040e tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1513 microversion: 2.1 time: 0.147942 May 12 09:38:42.259792 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 282/549] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:38:42 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:38:43.275269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9f16fa15-02fa-4710-804c-dcb4dedeca5a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:43.275950 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9f16fa15-02fa-4710-804c-dcb4dedeca5a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:43.282385 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9f16fa15-02fa-4710-804c-dcb4dedeca5a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:43.282912 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9f16fa15-02fa-4710-804c-dcb4dedeca5a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:43.283688 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9f16fa15-02fa-4710-804c-dcb4dedeca5a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:43.284129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9f16fa15-02fa-4710-804c-dcb4dedeca5a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:43.309038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-408035dd-ec1e-4fd3-86e5-833feefbf48f req-dfdde54c-a4ed-41ca-8e21-0f065d0102d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28f509a-6478-4c54-b6a2-18006ba9b4e4", "name": "network-vif-deleted", "tag": "8acbd1cf-7e16-4732-87ec-d4881219909c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:38:43.318381 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-408035dd-ec1e-4fd3-86e5-833feefbf48f req-dfdde54c-a4ed-41ca-8e21-0f065d0102d4 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:43.318823 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-408035dd-ec1e-4fd3-86e5-833feefbf48f req-dfdde54c-a4ed-41ca-8e21-0f065d0102d4 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:43.330380 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-408035dd-ec1e-4fd3-86e5-833feefbf48f req-dfdde54c-a4ed-41ca-8e21-0f065d0102d4 service nova] Creating event network-vif-deleted:8acbd1cf-7e16-4732-87ec-d4881219909c for instance b28f509a-6478-4c54-b6a2-18006ba9b4e4 on hv-cinder-83769 May 12 09:38:43.335649 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-408035dd-ec1e-4fd3-86e5-833feefbf48f req-dfdde54c-a4ed-41ca-8e21-0f065d0102d4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030050 May 12 09:38:43.336553 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 283/550] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:38:43.358820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9f16fa15-02fa-4710-804c-dcb4dedeca5a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd6d3e1b6ea49d4a75e5f7e105ea0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59546c2ca0074bb5b77b7c5e64d9c068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:38:43.367030 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9f16fa15-02fa-4710-804c-dcb4dedeca5a tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 200 len: 1471 microversion: 2.1 time: 0.095634 May 12 09:38:43.367785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 268/551] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:38:43 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 1471 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:38:44.386581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:44.388039 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] [instance: b28f509a-6478-4c54-b6a2-18006ba9b4e4] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:44.394570 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:44.395023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:44.395789 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:44.396224 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:44.410073 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] HTTP exception thrown: Instance b28f509a-6478-4c54-b6a2-18006ba9b4e4 could not be found. May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Request method failure captured: May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 HTTP/1.1 May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNSkuhwIOzSrLDGD03M1ob123pgH2AJiVgIge9cgDne3QX0CCrO3IY8Q6d9gLDyaFyAWivzzFoPx6UuahZxQrNnkACijSv9oK-0cn1V_s3V4zdD02Dyo1l7GAyq-0jQY41UV_SJ6pvdrp6MCzrJt9Uiy_g4yz15zWfYYhYO1TXWheyQ May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: 59546c2ca0074bb5b77b7c5e64d9c068 May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-VolumesSnapshotTestJSON-625626064 May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:38:44.411654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_59546c2ca0074bb5b77b7c5e64d9c068", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59546c2ca0074bb5b77b7c5e64d9c068"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/59546c2ca0074bb5b77b7c5e64d9c068"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/59546c2ca0074bb5b77b7c5e64d9c068"}]}] May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-VolumesSnapshotTestJSON-625626064 May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: 59546c2ca0074bb5b77b7c5e64d9c068 May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-625626064 May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-VolumesSnapshotTestJSON-625626064-project May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 7dd6d3e1b6ea49d4a75e5f7e105ea0f0 May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-VolumesSnapshotTestJSON-625626064-project May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance b28f509a-6478-4c54-b6a2-18006ba9b4e4 could not be found. May 12 09:38:44.413194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'b28f509a-6478-4c54-b6a2-18006ba9b4e4'} May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b28f509a-6478-4c54-b6a2-18006ba9b4e4 could not be found. May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:38:44.414122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b28f509a-6478-4c54-b6a2-18006ba9b4e4 could not be found. May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b28f509a-6478-4c54-b6a2-18006ba9b4e4 could not be found. May 12 09:38:44.415556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:38:44.416930 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] Returning 404 to user: Instance b28f509a-6478-4c54-b6a2-18006ba9b4e4 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:38:44.416930 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4ed43444-13c6-4115-9772-55aea17338ef tempest-VolumesSnapshotTestJSON-625626064 tempest-VolumesSnapshotTestJSON-625626064-project] 10.222.0.60 "GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4" status: 404 len: 111 microversion: 2.1 time: 0.032171 May 12 09:38:44.416930 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 284/552] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:38:44 2022] GET /compute/v2.1/servers/b28f509a-6478-4c54-b6a2-18006ba9b4e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:38:54.697461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5c0cd4cc-0ab5-4bb8-b4c4-b6c1a40f8e1d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:38:54.698069 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5c0cd4cc-0ab5-4bb8-b4c4-b6c1a40f8e1d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:38:54.704257 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5c0cd4cc-0ab5-4bb8-b4c4-b6c1a40f8e1d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:54.704710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5c0cd4cc-0ab5-4bb8-b4c4-b6c1a40f8e1d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:54.705470 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5c0cd4cc-0ab5-4bb8-b4c4-b6c1a40f8e1d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:38:54.705921 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5c0cd4cc-0ab5-4bb8-b4c4-b6c1a40f8e1d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:38:54.728414 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5c0cd4cc-0ab5-4bb8-b4c4-b6c1a40f8e1d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/ips" status: 200 len: 146 microversion: 2.1 time: 0.034814 May 12 09:38:54.728981 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 269/553] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:38:54 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:39:00.547232 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1c94ed5c-969d-4d5e-98c6-4b87ef7ca02b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06b2a350-9635-4791-8d41-d4765f0b49b6"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:00.548311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1c94ed5c-969d-4d5e-98c6-4b87ef7ca02b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:00.554540 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1c94ed5c-969d-4d5e-98c6-4b87ef7ca02b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:00.554975 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1c94ed5c-969d-4d5e-98c6-4b87ef7ca02b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:00.555718 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1c94ed5c-969d-4d5e-98c6-4b87ef7ca02b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:00.556144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1c94ed5c-969d-4d5e-98c6-4b87ef7ca02b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:00.990394 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1c94ed5c-969d-4d5e-98c6-4b87ef7ca02b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446825 May 12 09:39:00.991173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 285/554] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:39:00 2022] POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:39:11.137014 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-701730424", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452"}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:11.338796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] validate_networks() for None {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:39:11.604555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:39:11.604978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:39:11.605452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:39:11.605859 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:39:11.606299 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:39:11.615365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:11.615813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:11.616615 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:11.617053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:11.633480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Getting quotas for project 2890a03f9cb34b87bf2debc1fa58a242. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:39:11.637583 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Getting quotas for user ba40cd3cab6144a8aabe860d446bcd8c and project 2890a03f9cb34b87bf2debc1fa58a242. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:39:11.648059 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:39:11.650291 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:39:11.693141 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-caa0c0d0-0c2b-4ea7-8cc7-5ff76e012936 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560129 May 12 09:39:11.693793 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 270/555] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:39:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:39:11.704164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1e41c24a-507a-4890-9035-4634ab940dc8 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:11.704861 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1e41c24a-507a-4890-9035-4634ab940dc8 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:11.759221 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1e41c24a-507a-4890-9035-4634ab940dc8 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:11.765521 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1e41c24a-507a-4890-9035-4634ab940dc8 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1214 microversion: 2.1 time: 0.065532 May 12 09:39:11.774951 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 286/556] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:11 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:12.783067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ead334cf-0085-4e72-97cc-81f9a12a8a4d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:12.783668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ead334cf-0085-4e72-97cc-81f9a12a8a4d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:12.789640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ead334cf-0085-4e72-97cc-81f9a12a8a4d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:12.790122 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ead334cf-0085-4e72-97cc-81f9a12a8a4d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:12.790878 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ead334cf-0085-4e72-97cc-81f9a12a8a4d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:12.791311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ead334cf-0085-4e72-97cc-81f9a12a8a4d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:12.849799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ead334cf-0085-4e72-97cc-81f9a12a8a4d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:12.856896 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ead334cf-0085-4e72-97cc-81f9a12a8a4d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1218 microversion: 2.1 time: 0.078226 May 12 09:39:12.857452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 271/557] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:12 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:13.874290 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2e44647e-50aa-4049-9c12-6e1d0864a590 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:13.874921 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2e44647e-50aa-4049-9c12-6e1d0864a590 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:13.882714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e44647e-50aa-4049-9c12-6e1d0864a590 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:13.883193 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e44647e-50aa-4049-9c12-6e1d0864a590 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:13.884218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e44647e-50aa-4049-9c12-6e1d0864a590 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:13.884653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e44647e-50aa-4049-9c12-6e1d0864a590 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:13.945639 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2e44647e-50aa-4049-9c12-6e1d0864a590 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:13.952832 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2e44647e-50aa-4049-9c12-6e1d0864a590 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1266 microversion: 2.1 time: 0.082633 May 12 09:39:13.953392 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 287/558] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:13 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:14.778438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-26005e29-6395-47f5-869c-ccb5b37645b6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:14.785235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-26005e29-6395-47f5-869c-ccb5b37645b6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:14.785692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-26005e29-6395-47f5-869c-ccb5b37645b6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:14.845644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-26005e29-6395-47f5-869c-ccb5b37645b6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Going to try to stop instance {{(pid=123509) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 09:39:14.889241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-26005e29-6395-47f5-869c-ccb5b37645b6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action" status: 202 len: 0 microversion: 2.1 time: 0.114271 May 12 09:39:14.889981 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 272/559] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:39:14 2022] POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:39:14.899995 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-003c75f2-9382-4355-92c7-9ed73f13e41f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:14.900588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-003c75f2-9382-4355-92c7-9ed73f13e41f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:14.908185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-003c75f2-9382-4355-92c7-9ed73f13e41f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:14.908954 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-003c75f2-9382-4355-92c7-9ed73f13e41f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:14.909859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-003c75f2-9382-4355-92c7-9ed73f13e41f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:14.910331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-003c75f2-9382-4355-92c7-9ed73f13e41f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:14.971770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-187be278-3526-45a0-b2bd-f1a7ebe8b221 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:14.972405 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-187be278-3526-45a0-b2bd-f1a7ebe8b221 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:14.978816 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-187be278-3526-45a0-b2bd-f1a7ebe8b221 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:14.979262 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-187be278-3526-45a0-b2bd-f1a7ebe8b221 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:14.980213 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-187be278-3526-45a0-b2bd-f1a7ebe8b221 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:14.980645 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-187be278-3526-45a0-b2bd-f1a7ebe8b221 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:15.426668 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-003c75f2-9382-4355-92c7-9ed73f13e41f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:15.434381 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-003c75f2-9382-4355-92c7-9ed73f13e41f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.538160 May 12 09:39:15.435034 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 288/560] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:14 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:15.467891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-187be278-3526-45a0-b2bd-f1a7ebe8b221 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:15.475707 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-187be278-3526-45a0-b2bd-f1a7ebe8b221 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.508722 May 12 09:39:15.476204 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 273/561] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:14 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:16.197862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-4d55b1e8-264f-47ca-a875-15ed72408159 req-316c103f-2695-442c-b823-bdc9a4b05e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb77a19-8eff-499f-9b73-650dbf04f59a", "tag": "4dd4cf01-e532-4759-ba91-3f4d4dfac741"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:16.212360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-4d55b1e8-264f-47ca-a875-15ed72408159 req-316c103f-2695-442c-b823-bdc9a4b05e84 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:16.212807 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-4d55b1e8-264f-47ca-a875-15ed72408159 req-316c103f-2695-442c-b823-bdc9a4b05e84 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:16.226394 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-4d55b1e8-264f-47ca-a875-15ed72408159 req-316c103f-2695-442c-b823-bdc9a4b05e84 service nova] Creating event network-changed:4dd4cf01-e532-4759-ba91-3f4d4dfac741 for instance fdb77a19-8eff-499f-9b73-650dbf04f59a on hv-cinder-83769 May 12 09:39:16.233107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-4d55b1e8-264f-47ca-a875-15ed72408159 req-316c103f-2695-442c-b823-bdc9a4b05e84 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042076 May 12 09:39:16.234268 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 289/562] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:39:16.451124 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-fb3f90d4-a634-44d1-8ecb-57649b82831b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:16.451727 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-fb3f90d4-a634-44d1-8ecb-57649b82831b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:16.458448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fb3f90d4-a634-44d1-8ecb-57649b82831b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:16.458934 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fb3f90d4-a634-44d1-8ecb-57649b82831b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:16.459708 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fb3f90d4-a634-44d1-8ecb-57649b82831b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:16.460142 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fb3f90d4-a634-44d1-8ecb-57649b82831b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:16.494047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7b424696-32db-493b-8a58-81bc4c864ce5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:16.494775 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7b424696-32db-493b-8a58-81bc4c864ce5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:16.501303 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7b424696-32db-493b-8a58-81bc4c864ce5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:16.501752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7b424696-32db-493b-8a58-81bc4c864ce5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:16.502731 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7b424696-32db-493b-8a58-81bc4c864ce5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:16.503160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7b424696-32db-493b-8a58-81bc4c864ce5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:16.736468 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-fb3f90d4-a634-44d1-8ecb-57649b82831b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:16.744566 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-fb3f90d4-a634-44d1-8ecb-57649b82831b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.297210 May 12 09:39:16.754715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 274/563] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:16 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:16.779456 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7b424696-32db-493b-8a58-81bc4c864ce5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:16.788599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7b424696-32db-493b-8a58-81bc4c864ce5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.299542 May 12 09:39:16.790201 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 290/564] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:16 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:17.762567 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3b194e35-8b62-4f33-b4b0-3b076cfd864e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:17.763108 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3b194e35-8b62-4f33-b4b0-3b076cfd864e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:17.769235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3b194e35-8b62-4f33-b4b0-3b076cfd864e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:17.769684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3b194e35-8b62-4f33-b4b0-3b076cfd864e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:17.770484 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3b194e35-8b62-4f33-b4b0-3b076cfd864e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:17.770917 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3b194e35-8b62-4f33-b4b0-3b076cfd864e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:17.805684 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-187a8f97-94b2-49f0-b462-e17def104862 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:17.806387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-187a8f97-94b2-49f0-b462-e17def104862 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:17.812808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-187a8f97-94b2-49f0-b462-e17def104862 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:17.813258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-187a8f97-94b2-49f0-b462-e17def104862 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:17.814040 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-187a8f97-94b2-49f0-b462-e17def104862 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:17.814482 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-187a8f97-94b2-49f0-b462-e17def104862 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:17.948855 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-3b194e35-8b62-4f33-b4b0-3b076cfd864e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:17.957313 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3b194e35-8b62-4f33-b4b0-3b076cfd864e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.198751 May 12 09:39:17.957989 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 275/565] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:17 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:17.980343 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-187a8f97-94b2-49f0-b462-e17def104862 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:17.988585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-187a8f97-94b2-49f0-b462-e17def104862 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.186668 May 12 09:39:17.989138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 291/566] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:17 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:18.974377 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-340df636-c684-486e-a7bf-a3f5c8c9433f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:18.974982 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-340df636-c684-486e-a7bf-a3f5c8c9433f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:18.981161 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-340df636-c684-486e-a7bf-a3f5c8c9433f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:18.981549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-340df636-c684-486e-a7bf-a3f5c8c9433f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:18.982320 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-340df636-c684-486e-a7bf-a3f5c8c9433f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:18.982747 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-340df636-c684-486e-a7bf-a3f5c8c9433f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:19.005112 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-63241a8f-75a3-4954-8774-d51a92fe7d05 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:19.005711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-63241a8f-75a3-4954-8774-d51a92fe7d05 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:19.012364 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-63241a8f-75a3-4954-8774-d51a92fe7d05 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:19.012886 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-63241a8f-75a3-4954-8774-d51a92fe7d05 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:19.013705 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-63241a8f-75a3-4954-8774-d51a92fe7d05 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:19.014235 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-63241a8f-75a3-4954-8774-d51a92fe7d05 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:19.173778 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-340df636-c684-486e-a7bf-a3f5c8c9433f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:19.181750 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-340df636-c684-486e-a7bf-a3f5c8c9433f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.211028 May 12 09:39:19.182234 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 276/567] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:18 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:19.184542 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-63241a8f-75a3-4954-8774-d51a92fe7d05 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:19.192826 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-63241a8f-75a3-4954-8774-d51a92fe7d05 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.192165 May 12 09:39:19.193392 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 292/568] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:18 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:20.199120 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-df3d9663-8f57-47ba-9921-61e4fe64ed77 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:20.199746 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-df3d9663-8f57-47ba-9921-61e4fe64ed77 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:20.207415 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-df3d9663-8f57-47ba-9921-61e4fe64ed77 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:20.207869 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-df3d9663-8f57-47ba-9921-61e4fe64ed77 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:20.208633 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-df3d9663-8f57-47ba-9921-61e4fe64ed77 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:20.209242 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-df3d9663-8f57-47ba-9921-61e4fe64ed77 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:20.209779 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7dee6329-e3f9-4e90-b7f2-3cb15119bf2e tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:20.210430 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7dee6329-e3f9-4e90-b7f2-3cb15119bf2e tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:20.216986 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7dee6329-e3f9-4e90-b7f2-3cb15119bf2e tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:20.217715 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7dee6329-e3f9-4e90-b7f2-3cb15119bf2e tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:20.218529 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7dee6329-e3f9-4e90-b7f2-3cb15119bf2e tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:20.218974 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7dee6329-e3f9-4e90-b7f2-3cb15119bf2e tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:20.417307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-df3d9663-8f57-47ba-9921-61e4fe64ed77 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:20.425518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7dee6329-e3f9-4e90-b7f2-3cb15119bf2e tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:20.426283 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-df3d9663-8f57-47ba-9921-61e4fe64ed77 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.230966 May 12 09:39:20.427034 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 277/569] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:20 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:20.432755 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7dee6329-e3f9-4e90-b7f2-3cb15119bf2e tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.227421 May 12 09:39:20.433432 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 293/570] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:20 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:21.444163 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9a6a0866-5511-4e02-8e94-e58edbc2f520 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:21.445139 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9a6a0866-5511-4e02-8e94-e58edbc2f520 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:21.449844 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9a518747-5b6c-410e-a249-56ec2f55964b tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:21.450773 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9a518747-5b6c-410e-a249-56ec2f55964b tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:21.451479 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a6a0866-5511-4e02-8e94-e58edbc2f520 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:21.451987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a6a0866-5511-4e02-8e94-e58edbc2f520 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:21.452680 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a6a0866-5511-4e02-8e94-e58edbc2f520 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:21.453107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a6a0866-5511-4e02-8e94-e58edbc2f520 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:21.457578 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a518747-5b6c-410e-a249-56ec2f55964b tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:21.458058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a518747-5b6c-410e-a249-56ec2f55964b tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:21.458837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a518747-5b6c-410e-a249-56ec2f55964b tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:21.459558 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a518747-5b6c-410e-a249-56ec2f55964b tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:21.643951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9a6a0866-5511-4e02-8e94-e58edbc2f520 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:21.650831 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9a518747-5b6c-410e-a249-56ec2f55964b tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:21.658611 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9a6a0866-5511-4e02-8e94-e58edbc2f520 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.218719 May 12 09:39:21.658966 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9a518747-5b6c-410e-a249-56ec2f55964b tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.212930 May 12 09:39:21.659476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 278/571] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:21 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:21.659602 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 294/572] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:21 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:22.676389 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-20ab6563-fa2f-46b1-ae80-6c4c6384170a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:22.677020 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4bf1ec18-277f-4815-ba34-cbd3806e20d5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:22.677409 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-20ab6563-fa2f-46b1-ae80-6c4c6384170a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:22.677519 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4bf1ec18-277f-4815-ba34-cbd3806e20d5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:22.683883 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20ab6563-fa2f-46b1-ae80-6c4c6384170a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:22.684107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4bf1ec18-277f-4815-ba34-cbd3806e20d5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:22.684676 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20ab6563-fa2f-46b1-ae80-6c4c6384170a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:22.684819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4bf1ec18-277f-4815-ba34-cbd3806e20d5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:22.685618 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20ab6563-fa2f-46b1-ae80-6c4c6384170a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:22.686013 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4bf1ec18-277f-4815-ba34-cbd3806e20d5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:22.686225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20ab6563-fa2f-46b1-ae80-6c4c6384170a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:22.686460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4bf1ec18-277f-4815-ba34-cbd3806e20d5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:22.875923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4bf1ec18-277f-4815-ba34-cbd3806e20d5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:22.879819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-20ab6563-fa2f-46b1-ae80-6c4c6384170a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:22.883138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4bf1ec18-277f-4815-ba34-cbd3806e20d5 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.210281 May 12 09:39:22.883980 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 295/573] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:22 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:22.887931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-20ab6563-fa2f-46b1-ae80-6c4c6384170a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.215353 May 12 09:39:22.888502 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 279/574] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:22 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:23.900326 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3800d3a2-abce-458e-8cf1-273e6474e401 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:23.900927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3800d3a2-abce-458e-8cf1-273e6474e401 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:23.904548 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-437c5850-7140-49aa-94db-5917cb4d5383 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:23.905157 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-437c5850-7140-49aa-94db-5917cb4d5383 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:23.907442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3800d3a2-abce-458e-8cf1-273e6474e401 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:23.907857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3800d3a2-abce-458e-8cf1-273e6474e401 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:23.908606 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3800d3a2-abce-458e-8cf1-273e6474e401 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:23.909035 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3800d3a2-abce-458e-8cf1-273e6474e401 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:23.911585 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-437c5850-7140-49aa-94db-5917cb4d5383 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:23.912041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-437c5850-7140-49aa-94db-5917cb4d5383 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:23.912841 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-437c5850-7140-49aa-94db-5917cb4d5383 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:23.913280 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-437c5850-7140-49aa-94db-5917cb4d5383 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:24.103438 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3800d3a2-abce-458e-8cf1-273e6474e401 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:24.113071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3800d3a2-abce-458e-8cf1-273e6474e401 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.216433 May 12 09:39:24.113882 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 296/575] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:23 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:24.120225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-437c5850-7140-49aa-94db-5917cb4d5383 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:24.129098 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-437c5850-7140-49aa-94db-5917cb4d5383 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.228671 May 12 09:39:24.129943 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 280/576] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:23 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:24.237011 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-f79b89fd-94de-4898-8c03-bab99afe0f33 req-7d69f46f-0a35-4cb3-9b56-e30c556b8c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb77a19-8eff-499f-9b73-650dbf04f59a", "name": "network-vif-plugged", "status": "completed", "tag": "4dd4cf01-e532-4759-ba91-3f4d4dfac741"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:24.245094 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f79b89fd-94de-4898-8c03-bab99afe0f33 req-7d69f46f-0a35-4cb3-9b56-e30c556b8c9e service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:24.245555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f79b89fd-94de-4898-8c03-bab99afe0f33 req-7d69f46f-0a35-4cb3-9b56-e30c556b8c9e service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:24.256745 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-f79b89fd-94de-4898-8c03-bab99afe0f33 req-7d69f46f-0a35-4cb3-9b56-e30c556b8c9e service nova] Creating event network-vif-plugged:4dd4cf01-e532-4759-ba91-3f4d4dfac741 for instance fdb77a19-8eff-499f-9b73-650dbf04f59a on hv-cinder-83769 May 12 09:39:24.261923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-f79b89fd-94de-4898-8c03-bab99afe0f33 req-7d69f46f-0a35-4cb3-9b56-e30c556b8c9e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029246 May 12 09:39:24.262506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 297/577] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:39:25.131478 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9f4a85de-abde-497b-a529-a3f0ab82b9cb tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:25.132247 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9f4a85de-abde-497b-a529-a3f0ab82b9cb tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:25.140899 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9f4a85de-abde-497b-a529-a3f0ab82b9cb tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:25.141850 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9f4a85de-abde-497b-a529-a3f0ab82b9cb tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:25.142659 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9f4a85de-abde-497b-a529-a3f0ab82b9cb tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:25.143099 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9f4a85de-abde-497b-a529-a3f0ab82b9cb tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:25.148816 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6bc3df1f-98a0-4004-91e8-63fbf8f4265b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:25.149525 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6bc3df1f-98a0-4004-91e8-63fbf8f4265b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:25.155484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6bc3df1f-98a0-4004-91e8-63fbf8f4265b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:25.155928 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6bc3df1f-98a0-4004-91e8-63fbf8f4265b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:25.156728 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6bc3df1f-98a0-4004-91e8-63fbf8f4265b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:25.157694 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6bc3df1f-98a0-4004-91e8-63fbf8f4265b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:25.335486 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9f4a85de-abde-497b-a529-a3f0ab82b9cb tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:25.339183 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6bc3df1f-98a0-4004-91e8-63fbf8f4265b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:25.342798 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9f4a85de-abde-497b-a529-a3f0ab82b9cb tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.217638 May 12 09:39:25.343379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 281/578] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:25 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:25.346851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6bc3df1f-98a0-4004-91e8-63fbf8f4265b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.203140 May 12 09:39:25.347412 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 298/579] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:25 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:26.359434 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c6971611-8636-4d1d-a37b-767e597b0911 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:26.360608 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c6971611-8636-4d1d-a37b-767e597b0911 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:26.363958 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8535383d-7f2a-4454-b9f1-4718bf1ef14f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:26.364558 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8535383d-7f2a-4454-b9f1-4718bf1ef14f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:26.367015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c6971611-8636-4d1d-a37b-767e597b0911 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:26.367467 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c6971611-8636-4d1d-a37b-767e597b0911 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:26.368234 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c6971611-8636-4d1d-a37b-767e597b0911 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:26.368672 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c6971611-8636-4d1d-a37b-767e597b0911 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:26.370685 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8535383d-7f2a-4454-b9f1-4718bf1ef14f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:26.371132 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8535383d-7f2a-4454-b9f1-4718bf1ef14f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:26.371882 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8535383d-7f2a-4454-b9f1-4718bf1ef14f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:26.372320 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8535383d-7f2a-4454-b9f1-4718bf1ef14f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:26.556377 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c6971611-8636-4d1d-a37b-767e597b0911 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:26.559140 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8535383d-7f2a-4454-b9f1-4718bf1ef14f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:26.563932 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c6971611-8636-4d1d-a37b-767e597b0911 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.208324 May 12 09:39:26.564504 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 282/580] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:26 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:26.566736 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8535383d-7f2a-4454-b9f1-4718bf1ef14f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.207091 May 12 09:39:26.567287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 299/581] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:26 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:27.581034 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-179c952a-3e51-458d-a273-f23ba410416f tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:27.581621 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-179c952a-3e51-458d-a273-f23ba410416f tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:27.583161 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cea10fe9-5d4c-46c2-a902-7e361e3a5966 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:27.583765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cea10fe9-5d4c-46c2-a902-7e361e3a5966 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:27.587956 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-179c952a-3e51-458d-a273-f23ba410416f tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:27.588403 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-179c952a-3e51-458d-a273-f23ba410416f tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:27.589158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-179c952a-3e51-458d-a273-f23ba410416f tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:27.589584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-179c952a-3e51-458d-a273-f23ba410416f tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:27.590124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cea10fe9-5d4c-46c2-a902-7e361e3a5966 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:27.590571 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cea10fe9-5d4c-46c2-a902-7e361e3a5966 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:27.591335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cea10fe9-5d4c-46c2-a902-7e361e3a5966 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:27.591766 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cea10fe9-5d4c-46c2-a902-7e361e3a5966 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:27.775134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-179c952a-3e51-458d-a273-f23ba410416f tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:27.778216 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-cea10fe9-5d4c-46c2-a902-7e361e3a5966 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:27.782826 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-179c952a-3e51-458d-a273-f23ba410416f tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.205642 May 12 09:39:27.783393 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 283/582] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:27 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:27.786495 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cea10fe9-5d4c-46c2-a902-7e361e3a5966 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.207143 May 12 09:39:27.787046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 300/583] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:27 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:28.800261 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b03f6fcb-e6fd-4a70-a60e-9cedfa47fc37 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:28.800880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b03f6fcb-e6fd-4a70-a60e-9cedfa47fc37 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:28.803648 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a857e6c8-0507-434a-9e43-a6e830ce0de3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:28.804330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a857e6c8-0507-434a-9e43-a6e830ce0de3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:28.807421 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b03f6fcb-e6fd-4a70-a60e-9cedfa47fc37 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:28.807876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b03f6fcb-e6fd-4a70-a60e-9cedfa47fc37 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:28.808967 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b03f6fcb-e6fd-4a70-a60e-9cedfa47fc37 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:28.809203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b03f6fcb-e6fd-4a70-a60e-9cedfa47fc37 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:28.811329 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a857e6c8-0507-434a-9e43-a6e830ce0de3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:28.811809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a857e6c8-0507-434a-9e43-a6e830ce0de3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:28.812703 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a857e6c8-0507-434a-9e43-a6e830ce0de3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:28.814059 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a857e6c8-0507-434a-9e43-a6e830ce0de3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:28.998045 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b03f6fcb-e6fd-4a70-a60e-9cedfa47fc37 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:29.001428 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a857e6c8-0507-434a-9e43-a6e830ce0de3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:29.005963 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b03f6fcb-e6fd-4a70-a60e-9cedfa47fc37 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.210095 May 12 09:39:29.006725 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 284/584] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:28 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:29.009614 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a857e6c8-0507-434a-9e43-a6e830ce0de3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.209641 May 12 09:39:29.010211 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 301/585] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:28 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:30.023168 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1c4ff55f-16e7-417d-a93f-6b9f51b104f0 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:30.023809 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1c4ff55f-16e7-417d-a93f-6b9f51b104f0 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:30.026490 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1f9b4500-84d9-491d-b0a1-301bc443c56c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:30.027095 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1f9b4500-84d9-491d-b0a1-301bc443c56c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:30.030320 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1c4ff55f-16e7-417d-a93f-6b9f51b104f0 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:30.030772 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1c4ff55f-16e7-417d-a93f-6b9f51b104f0 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:30.031548 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1c4ff55f-16e7-417d-a93f-6b9f51b104f0 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:30.031995 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1c4ff55f-16e7-417d-a93f-6b9f51b104f0 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:30.033225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1f9b4500-84d9-491d-b0a1-301bc443c56c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:30.033671 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1f9b4500-84d9-491d-b0a1-301bc443c56c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:30.034456 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1f9b4500-84d9-491d-b0a1-301bc443c56c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:30.034905 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1f9b4500-84d9-491d-b0a1-301bc443c56c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:30.215505 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1c4ff55f-16e7-417d-a93f-6b9f51b104f0 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:30.218574 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1f9b4500-84d9-491d-b0a1-301bc443c56c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:30.223186 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1c4ff55f-16e7-417d-a93f-6b9f51b104f0 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.203888 May 12 09:39:30.223810 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 285/586] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:30 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:30.226697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1f9b4500-84d9-491d-b0a1-301bc443c56c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.203923 May 12 09:39:30.227446 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 302/587] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:30 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:31.035099 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a617013f-cf5c-4930-b605-9ad528393fd6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:31.035997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a617013f-cf5c-4930-b605-9ad528393fd6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:31.041785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a617013f-cf5c-4930-b605-9ad528393fd6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:31.042265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a617013f-cf5c-4930-b605-9ad528393fd6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:31.043026 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a617013f-cf5c-4930-b605-9ad528393fd6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:31.043462 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a617013f-cf5c-4930-b605-9ad528393fd6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:31.065238 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a617013f-cf5c-4930-b605-9ad528393fd6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/ips" status: 200 len: 150 microversion: 2.1 time: 0.186192 May 12 09:39:31.065728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 286/588] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:39:30 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/ips => generated 150 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:39:31.240736 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1ac5780c-6690-4a74-bf84-b0e52978c46d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:31.241355 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1ac5780c-6690-4a74-bf84-b0e52978c46d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:31.244256 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-daaaa3f2-7aab-4602-8b2e-266b4107c7e6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:31.244999 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-daaaa3f2-7aab-4602-8b2e-266b4107c7e6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:31.247784 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ac5780c-6690-4a74-bf84-b0e52978c46d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:31.248305 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ac5780c-6690-4a74-bf84-b0e52978c46d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:31.249143 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ac5780c-6690-4a74-bf84-b0e52978c46d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:31.249585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ac5780c-6690-4a74-bf84-b0e52978c46d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:31.251317 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-daaaa3f2-7aab-4602-8b2e-266b4107c7e6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:31.251770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-daaaa3f2-7aab-4602-8b2e-266b4107c7e6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:31.252534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-daaaa3f2-7aab-4602-8b2e-266b4107c7e6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:31.253153 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-daaaa3f2-7aab-4602-8b2e-266b4107c7e6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:31.437125 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1ac5780c-6690-4a74-bf84-b0e52978c46d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:31.445019 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1ac5780c-6690-4a74-bf84-b0e52978c46d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.208303 May 12 09:39:31.445890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 303/589] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:31 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:31.466835 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-daaaa3f2-7aab-4602-8b2e-266b4107c7e6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:31.474499 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-daaaa3f2-7aab-4602-8b2e-266b4107c7e6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.234139 May 12 09:39:31.475065 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 287/590] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:31 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:32.462364 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cd88ef6b-83e5-4276-bbfa-28da70c91efe tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:32.462971 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cd88ef6b-83e5-4276-bbfa-28da70c91efe tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:32.469752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd88ef6b-83e5-4276-bbfa-28da70c91efe tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:32.470234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd88ef6b-83e5-4276-bbfa-28da70c91efe tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:32.470994 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd88ef6b-83e5-4276-bbfa-28da70c91efe tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:32.471432 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd88ef6b-83e5-4276-bbfa-28da70c91efe tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:32.491339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e4ab215f-9568-4344-805a-f96f7a0e159e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:32.492027 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e4ab215f-9568-4344-805a-f96f7a0e159e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:32.498507 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e4ab215f-9568-4344-805a-f96f7a0e159e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:32.499010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e4ab215f-9568-4344-805a-f96f7a0e159e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:32.499782 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e4ab215f-9568-4344-805a-f96f7a0e159e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:32.500211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e4ab215f-9568-4344-805a-f96f7a0e159e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:32.663042 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-cd88ef6b-83e5-4276-bbfa-28da70c91efe tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:32.668070 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e4ab215f-9568-4344-805a-f96f7a0e159e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:32.670717 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cd88ef6b-83e5-4276-bbfa-28da70c91efe tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.212151 May 12 09:39:32.671288 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 304/591] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:32 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:32.676183 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e4ab215f-9568-4344-805a-f96f7a0e159e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.188612 May 12 09:39:32.676731 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 288/592] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:32 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:33.687488 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-103d5758-0fc8-4773-8f08-4309bf03479d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:33.688100 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-103d5758-0fc8-4773-8f08-4309bf03479d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:33.692786 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-17a7fd33-8e7c-4a71-94cf-73a8c11c9499 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:33.693541 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-17a7fd33-8e7c-4a71-94cf-73a8c11c9499 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:33.694384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-103d5758-0fc8-4773-8f08-4309bf03479d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:33.694824 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-103d5758-0fc8-4773-8f08-4309bf03479d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:33.695583 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-103d5758-0fc8-4773-8f08-4309bf03479d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:33.696015 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-103d5758-0fc8-4773-8f08-4309bf03479d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:33.699413 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17a7fd33-8e7c-4a71-94cf-73a8c11c9499 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:33.699859 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17a7fd33-8e7c-4a71-94cf-73a8c11c9499 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:33.700611 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17a7fd33-8e7c-4a71-94cf-73a8c11c9499 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:33.701042 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17a7fd33-8e7c-4a71-94cf-73a8c11c9499 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:33.879619 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-103d5758-0fc8-4773-8f08-4309bf03479d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:33.886497 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-17a7fd33-8e7c-4a71-94cf-73a8c11c9499 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:33.887050 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-103d5758-0fc8-4773-8f08-4309bf03479d tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.203477 May 12 09:39:33.887617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 305/593] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:33 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:33.894677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-17a7fd33-8e7c-4a71-94cf-73a8c11c9499 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.205619 May 12 09:39:33.895243 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 289/594] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:33 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:34.904310 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a946a594-2393-4f42-ab39-f8d1a3640f2c tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:34.904909 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a946a594-2393-4f42-ab39-f8d1a3640f2c tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:34.911262 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a946a594-2393-4f42-ab39-f8d1a3640f2c tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:34.911399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b7d3867a-9c70-4350-a246-01ad7219cc9f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:34.911792 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a946a594-2393-4f42-ab39-f8d1a3640f2c tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:34.911967 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b7d3867a-9c70-4350-a246-01ad7219cc9f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:34.912444 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a946a594-2393-4f42-ab39-f8d1a3640f2c tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:34.912873 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a946a594-2393-4f42-ab39-f8d1a3640f2c tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:34.918828 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b7d3867a-9c70-4350-a246-01ad7219cc9f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:34.919279 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b7d3867a-9c70-4350-a246-01ad7219cc9f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:34.920037 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b7d3867a-9c70-4350-a246-01ad7219cc9f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:34.920530 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b7d3867a-9c70-4350-a246-01ad7219cc9f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:35.098564 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a946a594-2393-4f42-ab39-f8d1a3640f2c tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:35.106323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a946a594-2393-4f42-ab39-f8d1a3640f2c tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1314 microversion: 2.1 time: 0.205696 May 12 09:39:35.106933 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 306/595] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:34 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:35.110941 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b7d3867a-9c70-4350-a246-01ad7219cc9f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:35.118770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b7d3867a-9c70-4350-a246-01ad7219cc9f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.211096 May 12 09:39:35.119332 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 290/596] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:34 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:36.123576 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e7096c6a-c417-4e35-accb-bbbc221d9162 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:36.124178 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e7096c6a-c417-4e35-accb-bbbc221d9162 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:36.131145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e7096c6a-c417-4e35-accb-bbbc221d9162 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.131585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e7096c6a-c417-4e35-accb-bbbc221d9162 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.132341 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e7096c6a-c417-4e35-accb-bbbc221d9162 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.132781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e7096c6a-c417-4e35-accb-bbbc221d9162 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.135833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0f8704bb-bdf6-49ed-bcd8-3aa373fa0a6d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:36.136444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0f8704bb-bdf6-49ed-bcd8-3aa373fa0a6d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:36.142676 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0f8704bb-bdf6-49ed-bcd8-3aa373fa0a6d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.143124 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0f8704bb-bdf6-49ed-bcd8-3aa373fa0a6d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.143887 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0f8704bb-bdf6-49ed-bcd8-3aa373fa0a6d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.144323 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0f8704bb-bdf6-49ed-bcd8-3aa373fa0a6d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.332389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e7096c6a-c417-4e35-accb-bbbc221d9162 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:36.335631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0f8704bb-bdf6-49ed-bcd8-3aa373fa0a6d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:36.339695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e7096c6a-c417-4e35-accb-bbbc221d9162 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1464 microversion: 2.1 time: 0.219910 May 12 09:39:36.340459 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 307/597] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:36 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1464 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:36.343822 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0f8704bb-bdf6-49ed-bcd8-3aa373fa0a6d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.212036 May 12 09:39:36.344469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 291/598] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:36 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:36.379580 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-26648bca-eaa4-4f01-b841-8df6c5ae2bce tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:36.380066 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-26648bca-eaa4-4f01-b841-8df6c5ae2bce tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:36.386104 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-26648bca-eaa4-4f01-b841-8df6c5ae2bce tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.386545 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-26648bca-eaa4-4f01-b841-8df6c5ae2bce tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.387287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-26648bca-eaa4-4f01-b841-8df6c5ae2bce tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.387714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-26648bca-eaa4-4f01-b841-8df6c5ae2bce tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.411119 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-26648bca-eaa4-4f01-b841-8df6c5ae2bce tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:39:36.483405 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-26648bca-eaa4-4f01-b841-8df6c5ae2bce tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "DELETE /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 204 len: 0 microversion: 2.1 time: 0.108009 May 12 09:39:36.483982 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 308/599] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:39:36 2022] DELETE /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:39:36.492728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-128e5997-1fc9-4330-b5d4-8f48fd616924 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:36.493322 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-128e5997-1fc9-4330-b5d4-8f48fd616924 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:36.499124 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-128e5997-1fc9-4330-b5d4-8f48fd616924 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.499564 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-128e5997-1fc9-4330-b5d4-8f48fd616924 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.501015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-128e5997-1fc9-4330-b5d4-8f48fd616924 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.501517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-128e5997-1fc9-4330-b5d4-8f48fd616924 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.626875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-999a7f23-eb9b-465d-8b29-97001e72c883 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0937877-1982-4445-85be-ca0dcd958bbf"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:36.628038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-999a7f23-eb9b-465d-8b29-97001e72c883 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:36.634640 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-999a7f23-eb9b-465d-8b29-97001e72c883 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.635093 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-999a7f23-eb9b-465d-8b29-97001e72c883 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.635866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-999a7f23-eb9b-465d-8b29-97001e72c883 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:36.636301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-999a7f23-eb9b-465d-8b29-97001e72c883 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:36.670059 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-128e5997-1fc9-4330-b5d4-8f48fd616924 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:36.685131 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-128e5997-1fc9-4330-b5d4-8f48fd616924 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1470 microversion: 2.1 time: 0.196327 May 12 09:39:36.685726 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 292/600] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:36 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:37.362723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-26bfc7ed-df69-48c4-845a-32224dfbe210 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:37.363379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-26bfc7ed-df69-48c4-845a-32224dfbe210 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:37.369600 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-26bfc7ed-df69-48c4-845a-32224dfbe210 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:37.370094 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-26bfc7ed-df69-48c4-845a-32224dfbe210 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:37.370858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-26bfc7ed-df69-48c4-845a-32224dfbe210 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:37.371293 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-26bfc7ed-df69-48c4-845a-32224dfbe210 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:37.496304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-26bfc7ed-df69-48c4-845a-32224dfbe210 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:37.504202 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-26bfc7ed-df69-48c4-845a-32224dfbe210 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.146108 May 12 09:39:37.504769 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 293/601] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:37 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:37.705299 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9be12bde-6046-4861-be1f-85d09e1f3802 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:37.705820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9be12bde-6046-4861-be1f-85d09e1f3802 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:37.711811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9be12bde-6046-4861-be1f-85d09e1f3802 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:37.712255 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9be12bde-6046-4861-be1f-85d09e1f3802 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:37.713013 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9be12bde-6046-4861-be1f-85d09e1f3802 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:37.713439 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9be12bde-6046-4861-be1f-85d09e1f3802 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:37.839996 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9be12bde-6046-4861-be1f-85d09e1f3802 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:37.848309 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9be12bde-6046-4861-be1f-85d09e1f3802 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1470 microversion: 2.1 time: 0.147580 May 12 09:39:37.849153 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 294/602] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:37 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:38.522140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-fd8a46e7-ddf5-42f9-9a59-b59e2d7cef93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:38.522822 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-fd8a46e7-ddf5-42f9-9a59-b59e2d7cef93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:38.529004 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fd8a46e7-ddf5-42f9-9a59-b59e2d7cef93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:38.529449 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fd8a46e7-ddf5-42f9-9a59-b59e2d7cef93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:38.530242 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fd8a46e7-ddf5-42f9-9a59-b59e2d7cef93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:38.530675 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fd8a46e7-ddf5-42f9-9a59-b59e2d7cef93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:38.655577 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-fd8a46e7-ddf5-42f9-9a59-b59e2d7cef93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:38.663319 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-fd8a46e7-ddf5-42f9-9a59-b59e2d7cef93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.145030 May 12 09:39:38.663911 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 295/603] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:38 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:38.866045 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ba2bbcaa-55a7-4def-9aea-91e7fb0389e2 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:38.866653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ba2bbcaa-55a7-4def-9aea-91e7fb0389e2 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:38.872576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ba2bbcaa-55a7-4def-9aea-91e7fb0389e2 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:38.873025 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ba2bbcaa-55a7-4def-9aea-91e7fb0389e2 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:38.873792 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ba2bbcaa-55a7-4def-9aea-91e7fb0389e2 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:38.874253 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ba2bbcaa-55a7-4def-9aea-91e7fb0389e2 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:39.000208 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ba2bbcaa-55a7-4def-9aea-91e7fb0389e2 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:39.007392 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ba2bbcaa-55a7-4def-9aea-91e7fb0389e2 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1470 microversion: 2.1 time: 0.145190 May 12 09:39:39.007968 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 296/604] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:38 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1470 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:39.681117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-577e7e14-04ed-49ae-9c69-ac87e52093d6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:39.681813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-577e7e14-04ed-49ae-9c69-ac87e52093d6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:39.687999 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-577e7e14-04ed-49ae-9c69-ac87e52093d6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:39.688441 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-577e7e14-04ed-49ae-9c69-ac87e52093d6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:39.689188 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-577e7e14-04ed-49ae-9c69-ac87e52093d6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:39.689616 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-577e7e14-04ed-49ae-9c69-ac87e52093d6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:39.815987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-577e7e14-04ed-49ae-9c69-ac87e52093d6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:39.823800 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-577e7e14-04ed-49ae-9c69-ac87e52093d6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.146541 May 12 09:39:39.824361 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 297/605] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:39 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:40.024516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d9a94eed-3639-47ce-8f1d-8626190a909a tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:40.025152 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d9a94eed-3639-47ce-8f1d-8626190a909a tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:40.031078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d9a94eed-3639-47ce-8f1d-8626190a909a tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:40.031523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d9a94eed-3639-47ce-8f1d-8626190a909a tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:40.032282 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d9a94eed-3639-47ce-8f1d-8626190a909a tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:40.033364 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d9a94eed-3639-47ce-8f1d-8626190a909a tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:40.159304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d9a94eed-3639-47ce-8f1d-8626190a909a tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:40.166729 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d9a94eed-3639-47ce-8f1d-8626190a909a tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1470 microversion: 2.1 time: 0.146027 May 12 09:39:40.167512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 298/606] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:40 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:40.840331 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-33a726b9-b2a9-40a9-81d9-be3b1b837b72 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:40.840937 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-33a726b9-b2a9-40a9-81d9-be3b1b837b72 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:40.847163 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-33a726b9-b2a9-40a9-81d9-be3b1b837b72 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:40.847603 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-33a726b9-b2a9-40a9-81d9-be3b1b837b72 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:40.848417 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-33a726b9-b2a9-40a9-81d9-be3b1b837b72 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:40.848846 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-33a726b9-b2a9-40a9-81d9-be3b1b837b72 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:40.971201 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-33a726b9-b2a9-40a9-81d9-be3b1b837b72 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:40.978743 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-33a726b9-b2a9-40a9-81d9-be3b1b837b72 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.142227 May 12 09:39:40.979306 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 299/607] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:40 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:41.183618 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-59a6262f-24f1-4966-b77b-e2aa8087dd50 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:41.184240 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-59a6262f-24f1-4966-b77b-e2aa8087dd50 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:41.190157 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-59a6262f-24f1-4966-b77b-e2aa8087dd50 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:41.190606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-59a6262f-24f1-4966-b77b-e2aa8087dd50 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:41.191372 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-59a6262f-24f1-4966-b77b-e2aa8087dd50 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:41.191807 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-59a6262f-24f1-4966-b77b-e2aa8087dd50 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:41.325676 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-59a6262f-24f1-4966-b77b-e2aa8087dd50 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:41.333553 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-59a6262f-24f1-4966-b77b-e2aa8087dd50 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1470 microversion: 2.1 time: 0.153746 May 12 09:39:41.334144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 300/608] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:41 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:41.996710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-da770c44-cc58-48f1-ba1c-92b4f0923aca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:41.997428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-da770c44-cc58-48f1-ba1c-92b4f0923aca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:42.003873 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-da770c44-cc58-48f1-ba1c-92b4f0923aca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:42.004314 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-da770c44-cc58-48f1-ba1c-92b4f0923aca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:42.005067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-da770c44-cc58-48f1-ba1c-92b4f0923aca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:42.005495 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-da770c44-cc58-48f1-ba1c-92b4f0923aca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:42.151881 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-da770c44-cc58-48f1-ba1c-92b4f0923aca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:42.161178 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-da770c44-cc58-48f1-ba1c-92b4f0923aca tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1724 microversion: 2.1 time: 0.168433 May 12 09:39:42.161747 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 301/609] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:41 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:42.302629 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-999a7f23-eb9b-465d-8b29-97001e72c883 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.679902 May 12 09:39:42.303337 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 309/610] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:39:36 2022] POST /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments => generated 194 bytes in 5682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:39:42.350993 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-65c8c82d-7f3a-4d80-8827-133afd2e3b77 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:42.351897 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-65c8c82d-7f3a-4d80-8827-133afd2e3b77 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:42.357995 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-65c8c82d-7f3a-4d80-8827-133afd2e3b77 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:42.358393 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-65c8c82d-7f3a-4d80-8827-133afd2e3b77 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:42.359157 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-65c8c82d-7f3a-4d80-8827-133afd2e3b77 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:42.359607 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-65c8c82d-7f3a-4d80-8827-133afd2e3b77 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:42.481694 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-65c8c82d-7f3a-4d80-8827-133afd2e3b77 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:42.488775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-65c8c82d-7f3a-4d80-8827-133afd2e3b77 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1470 microversion: 2.1 time: 0.141708 May 12 09:39:42.489347 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 302/611] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:42 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1470 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:43.178265 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-05b546a9-aba8-457f-9637-823f5c5fee13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:43.179032 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-05b546a9-aba8-457f-9637-823f5c5fee13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:43.188154 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-05b546a9-aba8-457f-9637-823f5c5fee13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:43.189240 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-05b546a9-aba8-457f-9637-823f5c5fee13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:43.190749 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-05b546a9-aba8-457f-9637-823f5c5fee13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:43.191403 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-05b546a9-aba8-457f-9637-823f5c5fee13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:43.505858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a33b5770-3066-408c-bcd1-90756cc8cb20 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:43.506766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a33b5770-3066-408c-bcd1-90756cc8cb20 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:43.513798 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a33b5770-3066-408c-bcd1-90756cc8cb20 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:43.514286 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a33b5770-3066-408c-bcd1-90756cc8cb20 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:43.515069 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a33b5770-3066-408c-bcd1-90756cc8cb20 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:43.515509 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a33b5770-3066-408c-bcd1-90756cc8cb20 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:43.676195 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-05b546a9-aba8-457f-9637-823f5c5fee13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:43.683865 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-05b546a9-aba8-457f-9637-823f5c5fee13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1701 microversion: 2.1 time: 0.510252 May 12 09:39:43.684429 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 310/612] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:43 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1701 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:43.701305 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-570f0e89-6a03-48f1-a59f-f74baf78449b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:43.707485 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-570f0e89-6a03-48f1-a59f-f74baf78449b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:43.708016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-570f0e89-6a03-48f1-a59f-f74baf78449b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:43.775352 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-570f0e89-6a03-48f1-a59f-f74baf78449b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Going to try to start instance {{(pid=123510) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 09:39:43.826615 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-570f0e89-6a03-48f1-a59f-f74baf78449b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action" status: 202 len: 0 microversion: 2.1 time: 0.128922 May 12 09:39:43.827294 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 311/613] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:39:43 2022] POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:39:43.847609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a33b5770-3066-408c-bcd1-90756cc8cb20 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40cd3cab6144a8aabe860d446bcd8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2890a03f9cb34b87bf2debc1fa58a242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:43.852051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9a9d1020-243f-4e99-bd0b-19ae8fb30e19 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:43.853405 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9a9d1020-243f-4e99-bd0b-19ae8fb30e19 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:43.858930 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a33b5770-3066-408c-bcd1-90756cc8cb20 tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 200 len: 1470 microversion: 2.1 time: 0.357383 May 12 09:39:43.859863 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 303/614] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:43 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 1470 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:43.865247 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a9d1020-243f-4e99-bd0b-19ae8fb30e19 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:43.865820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a9d1020-243f-4e99-bd0b-19ae8fb30e19 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:43.866698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a9d1020-243f-4e99-bd0b-19ae8fb30e19 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:43.867258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a9d1020-243f-4e99-bd0b-19ae8fb30e19 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:43.933189 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-4c3dccb0-3f7c-4d3b-9bc8-93e8fc432053 req-5a7d28c7-3a80-49fe-83a5-2d4bd1bf8933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb77a19-8eff-499f-9b73-650dbf04f59a", "name": "network-vif-deleted", "tag": "4dd4cf01-e532-4759-ba91-3f4d4dfac741"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:43.943105 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-4c3dccb0-3f7c-4d3b-9bc8-93e8fc432053 req-5a7d28c7-3a80-49fe-83a5-2d4bd1bf8933 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:43.943886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-4c3dccb0-3f7c-4d3b-9bc8-93e8fc432053 req-5a7d28c7-3a80-49fe-83a5-2d4bd1bf8933 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:43.959373 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-4c3dccb0-3f7c-4d3b-9bc8-93e8fc432053 req-5a7d28c7-3a80-49fe-83a5-2d4bd1bf8933 service nova] Creating event network-vif-deleted:4dd4cf01-e532-4759-ba91-3f4d4dfac741 for instance fdb77a19-8eff-499f-9b73-650dbf04f59a on hv-cinder-83769 May 12 09:39:43.966363 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-4c3dccb0-3f7c-4d3b-9bc8-93e8fc432053 req-5a7d28c7-3a80-49fe-83a5-2d4bd1bf8933 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104343 May 12 09:39:43.968242 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 304/615] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:39:44.083121 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9a9d1020-243f-4e99-bd0b-19ae8fb30e19 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:44.090886 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9a9d1020-243f-4e99-bd0b-19ae8fb30e19 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1710 microversion: 2.1 time: 0.245467 May 12 09:39:44.091493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 312/616] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:43 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1710 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:44.878352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:44.878968 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] [instance: fdb77a19-8eff-499f-9b73-650dbf04f59a] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:44.885696 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:44.886166 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:44.887031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:44.887728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:44.902372 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] HTTP exception thrown: Instance fdb77a19-8eff-499f-9b73-650dbf04f59a could not be found. May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Request method failure captured: May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a HTTP/1.1 May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNW5sbXzNHqIJDaeJW26llIIpEsYc1wYnMEczM1EV4cV_v-ndplrNt02AX9A0CzDWmXKhYYUezS8mfSU8al14F27NFRH9MvVN3lDaagiN17-NjUQIWuscDqMdVEtuFIuLD2bYaMNNFNsVGIL2NT-ttl9k_bLAWOwYRBUz7Ob8-ksNN0 May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: 2890a03f9cb34b87bf2debc1fa58a242 May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-VolumesNegativeTest-717701186 May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:39:44.904047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_2890a03f9cb34b87bf2debc1fa58a242", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2890a03f9cb34b87bf2debc1fa58a242"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/2890a03f9cb34b87bf2debc1fa58a242"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/2890a03f9cb34b87bf2debc1fa58a242"}]}] May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-VolumesNegativeTest-717701186 May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: 2890a03f9cb34b87bf2debc1fa58a242 May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-VolumesNegativeTest-717701186 May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-VolumesNegativeTest-717701186-project May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: ba40cd3cab6144a8aabe860d446bcd8c May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-VolumesNegativeTest-717701186-project May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance fdb77a19-8eff-499f-9b73-650dbf04f59a could not be found. May 12 09:39:44.905399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'fdb77a19-8eff-499f-9b73-650dbf04f59a'} May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb77a19-8eff-499f-9b73-650dbf04f59a could not be found. May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:39:44.906199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb77a19-8eff-499f-9b73-650dbf04f59a could not be found. May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb77a19-8eff-499f-9b73-650dbf04f59a could not be found. May 12 09:39:44.908031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:39:44.909833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] Returning 404 to user: Instance fdb77a19-8eff-499f-9b73-650dbf04f59a could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:39:44.909833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4386da55-4b1a-4c05-a892-b9f5a9164eaf tempest-VolumesNegativeTest-717701186 tempest-VolumesNegativeTest-717701186-project] 10.222.0.60 "GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a" status: 404 len: 111 microversion: 2.1 time: 0.031914 May 12 09:39:44.909833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 305/617] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:44 2022] GET /compute/v2.1/servers/fdb77a19-8eff-499f-9b73-650dbf04f59a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:39:45.108372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a01d5356-71f0-46cd-ba84-6da0f9fb8536 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:45.108970 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a01d5356-71f0-46cd-ba84-6da0f9fb8536 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:45.117021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a01d5356-71f0-46cd-ba84-6da0f9fb8536 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:45.117476 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a01d5356-71f0-46cd-ba84-6da0f9fb8536 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:45.118270 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a01d5356-71f0-46cd-ba84-6da0f9fb8536 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:45.118701 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a01d5356-71f0-46cd-ba84-6da0f9fb8536 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:45.252428 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a01d5356-71f0-46cd-ba84-6da0f9fb8536 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:45.260480 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a01d5356-71f0-46cd-ba84-6da0f9fb8536 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1710 microversion: 2.1 time: 0.155833 May 12 09:39:45.261053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 313/618] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:45 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:46.279516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1c3e7de2-bb20-4b40-9cb5-6db3e912c910 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:46.280429 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1c3e7de2-bb20-4b40-9cb5-6db3e912c910 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:46.286921 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1c3e7de2-bb20-4b40-9cb5-6db3e912c910 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:46.287377 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1c3e7de2-bb20-4b40-9cb5-6db3e912c910 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:46.288144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1c3e7de2-bb20-4b40-9cb5-6db3e912c910 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:46.288583 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1c3e7de2-bb20-4b40-9cb5-6db3e912c910 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:46.427782 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1c3e7de2-bb20-4b40-9cb5-6db3e912c910 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:46.435688 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1c3e7de2-bb20-4b40-9cb5-6db3e912c910 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1714 microversion: 2.1 time: 0.160866 May 12 09:39:46.436228 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 306/619] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:46 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:51.107790 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-17703f6b-ee14-4835-bb3d-76d3c62dff3d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: .version_select at 0x7f8725737c10>, body: {"keypair": {"name": "tempest-keypair-1133437425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyy+gBZE2Fp8Q0lWLgq6+4gebQn/bRJ/zFdBKpYrQ0RPMZLywA2capVhkKxstggzLfL7LnCjF8lFw6cG7JMYQNwwtA2Wnig+3OpXPfB/3mOnEnljcKLq+7XttmScNxJuA=="}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:51.122372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-17703f6b-ee14-4835-bb3d-76d3c62dff3d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:39:51.126343 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-17703f6b-ee14-4835-bb3d-76d3c62dff3d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for user 6c8297034cfa40438000e7d94419a429 and project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:39:51.149627 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-17703f6b-ee14-4835-bb3d-76d3c62dff3d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045700 May 12 09:39:51.150263 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 314/620] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:39:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:39:53.361708 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-843600461", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8bd03ea-0f3b-46bf-82a8-531c929bec57"}], "security_groups": [{"name": "tempest-securitygroup--576200394"}], "key_name": "tempest-keypair-1133437425", "user_data": "}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:53.476841 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] validate_networks() for [('d8bd03ea-0f3b-46bf-82a8-531c929bec57', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:39:53.944318 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:39:53.945730 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:39:53.946394 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:39:53.946969 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:39:53.947542 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:39:53.957734 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:53.958641 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:53.959467 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:53.960178 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:53.981384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:39:53.994384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for user 6c8297034cfa40438000e7d94419a429 and project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:39:54.008461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:39:54.011864 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:39:54.082147 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8a11a0f4-5622-49c9-90a0-b36a86df62a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.725651 May 12 09:39:54.083056 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 307/621] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:39:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:39:54.093832 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8adcc05b-4ac8-40cf-a3d5-302ae7dbf4cd tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:54.099873 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8adcc05b-4ac8-40cf-a3d5-302ae7dbf4cd tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:54.164493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8adcc05b-4ac8-40cf-a3d5-302ae7dbf4cd tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:54.171586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8adcc05b-4ac8-40cf-a3d5-302ae7dbf4cd tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1241 microversion: 2.1 time: 0.082332 May 12 09:39:54.172147 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 315/622] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:54 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:55.189100 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5fb7423c-b579-4edc-b72d-ad35ccab386d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:55.189850 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5fb7423c-b579-4edc-b72d-ad35ccab386d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:55.260307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5fb7423c-b579-4edc-b72d-ad35ccab386d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:55.268942 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5fb7423c-b579-4edc-b72d-ad35ccab386d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1241 microversion: 2.1 time: 0.084840 May 12 09:39:55.269498 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 308/623] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:55 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:56.286665 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-660fb45b-5c38-4021-a750-c0eaa346814c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:56.287374 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-660fb45b-5c38-4021-a750-c0eaa346814c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:56.351712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-660fb45b-5c38-4021-a750-c0eaa346814c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:56.360643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-660fb45b-5c38-4021-a750-c0eaa346814c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1241 microversion: 2.1 time: 0.078124 May 12 09:39:56.372049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 316/624] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:56 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:57.379116 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-968a1d11-a056-4cc0-a096-2b75d980efed tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:57.380464 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-968a1d11-a056-4cc0-a096-2b75d980efed tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:57.478232 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-968a1d11-a056-4cc0-a096-2b75d980efed tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:57.485441 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-968a1d11-a056-4cc0-a096-2b75d980efed tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1241 microversion: 2.1 time: 0.110217 May 12 09:39:57.498803 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 309/625] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:57 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:58.530950 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b4419f39-d26d-4cf4-a6ec-d0ee7b183215 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:58.532652 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b4419f39-d26d-4cf4-a6ec-d0ee7b183215 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:58.546419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b4419f39-d26d-4cf4-a6ec-d0ee7b183215 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:58.546882 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b4419f39-d26d-4cf4-a6ec-d0ee7b183215 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:58.547734 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b4419f39-d26d-4cf4-a6ec-d0ee7b183215 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:58.550887 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b4419f39-d26d-4cf4-a6ec-d0ee7b183215 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:58.666018 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b4419f39-d26d-4cf4-a6ec-d0ee7b183215 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:58.681457 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b4419f39-d26d-4cf4-a6ec-d0ee7b183215 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1245 microversion: 2.1 time: 0.162026 May 12 09:39:58.681947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 317/626] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:58 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1245 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:39:59.194920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-bf6c1458-d930-464e-903b-c75034adc01f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:59.196097 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-bf6c1458-d930-464e-903b-c75034adc01f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:59.222151 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bf6c1458-d930-464e-903b-c75034adc01f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:59.222602 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bf6c1458-d930-464e-903b-c75034adc01f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:59.223392 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bf6c1458-d930-464e-903b-c75034adc01f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:59.223830 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bf6c1458-d930-464e-903b-c75034adc01f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:59.518682 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-bf6c1458-d930-464e-903b-c75034adc01f tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "POST /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/action" status: 200 len: 29192 microversion: 2.1 time: 0.776178 May 12 09:39:59.520137 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 310/627] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:39:58 2022] POST /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/action => generated 29192 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:39:59.549267 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-76bc3c90-43b1-48e4-a7c2-5e6db5f5239b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1094791940"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:39:59.552101 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-76bc3c90-43b1-48e4-a7c2-5e6db5f5239b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:59.577523 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-76bc3c90-43b1-48e4-a7c2-5e6db5f5239b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:59.577998 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-76bc3c90-43b1-48e4-a7c2-5e6db5f5239b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:59.593234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-76bc3c90-43b1-48e4-a7c2-5e6db5f5239b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:59.594520 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-76bc3c90-43b1-48e4-a7c2-5e6db5f5239b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:59.699534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7e1c3829-e8d7-403c-a1ce-3f79d4d3f140 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:39:59.700516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7e1c3829-e8d7-403c-a1ce-3f79d4d3f140 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:39:59.723567 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7e1c3829-e8d7-403c-a1ce-3f79d4d3f140 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:59.724028 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7e1c3829-e8d7-403c-a1ce-3f79d4d3f140 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:59.725041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7e1c3829-e8d7-403c-a1ce-3f79d4d3f140 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:39:59.725283 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7e1c3829-e8d7-403c-a1ce-3f79d4d3f140 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:39:59.941157 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7e1c3829-e8d7-403c-a1ce-3f79d4d3f140 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:39:59.960354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7e1c3829-e8d7-403c-a1ce-3f79d4d3f140 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1293 microversion: 2.1 time: 0.264871 May 12 09:39:59.961213 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 311/628] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:39:59 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1293 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:39:59.983059 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.network.security_group_api [None req-76bc3c90-43b1-48e4-a7c2-5e6db5f5239b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Removing security group 6fcbc622-37f4-4d6d-89bf-754d452f6498 from port 3af65aa8-83b2-410d-b24d-4b9b1b6dd549 May 12 09:40:00.770386 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-76bc3c90-43b1-48e4-a7c2-5e6db5f5239b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "POST /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/action" status: 202 len: 0 microversion: 2.1 time: 1.229517 May 12 09:40:00.772208 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 318/629] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:39:59 2022] POST /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/action => generated 0 bytes in 1233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:40:00.874331 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-b466c817-1639-4bf1-9258-6fd6d9c3ff5c req-0c459192-a65e-4b34-8188-2350bed2e181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a158cc80-2631-4dba-8071-ef5e07ec8ba1", "tag": "3af65aa8-83b2-410d-b24d-4b9b1b6dd549"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:00.901369 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-b466c817-1639-4bf1-9258-6fd6d9c3ff5c req-0c459192-a65e-4b34-8188-2350bed2e181 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:00.902253 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-b466c817-1639-4bf1-9258-6fd6d9c3ff5c req-0c459192-a65e-4b34-8188-2350bed2e181 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:00.937954 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-b466c817-1639-4bf1-9258-6fd6d9c3ff5c req-0c459192-a65e-4b34-8188-2350bed2e181 service nova] Creating event network-changed:3af65aa8-83b2-410d-b24d-4b9b1b6dd549 for instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 on hv-cinder-83769 May 12 09:40:00.956292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-b466c817-1639-4bf1-9258-6fd6d9c3ff5c req-0c459192-a65e-4b34-8188-2350bed2e181 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088867 May 12 09:40:00.957339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 312/630] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:00.985033 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-428de198-27ac-4d5d-92c0-bf64b455661e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:00.994990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-428de198-27ac-4d5d-92c0-bf64b455661e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:01.019929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-428de198-27ac-4d5d-92c0-bf64b455661e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:01.021305 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-428de198-27ac-4d5d-92c0-bf64b455661e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:01.022391 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-428de198-27ac-4d5d-92c0-bf64b455661e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:01.023200 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-428de198-27ac-4d5d-92c0-bf64b455661e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:01.293160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f3ea0fc2-7e7c-4310-b3f9-1c9d1a1021ac tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Action: 'create', calling method: .version_select at 0x7f8725843670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1560436604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJEozELGXDMC5/2Uj0GR2CSJ+CQnD3FEiIXxdshVb3IvQfsNkNvUgmIq+IkmMUIR/t2MMiVcq88jCPjmoOXO5p1QBtyh4TbZrhDUVrr9KWfzi+/EwxZJD+R+QtZ1QGlaw=="}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:01.325358 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-f3ea0fc2-7e7c-4310-b3f9-1c9d1a1021ac tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Getting quotas for project 170aaa04d8fe4170bf344d5667ae2814. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:40:01.337646 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-f3ea0fc2-7e7c-4310-b3f9-1c9d1a1021ac tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Getting quotas for user fde21f628031431583e085d26485451d and project 170aaa04d8fe4170bf344d5667ae2814. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:40:01.368662 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-428de198-27ac-4d5d-92c0-bf64b455661e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:01.381008 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-428de198-27ac-4d5d-92c0-bf64b455661e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1299 microversion: 2.1 time: 0.404268 May 12 09:40:01.384931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 313/631] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:00 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1299 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:01.404222 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f3ea0fc2-7e7c-4310-b3f9-1c9d1a1021ac tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.439768 May 12 09:40:01.408355 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 319/632] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:40:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:02.402254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-05543ddf-ac2d-4568-b468-c7f00e91261d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:02.402867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-05543ddf-ac2d-4568-b468-c7f00e91261d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:02.409215 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-05543ddf-ac2d-4568-b468-c7f00e91261d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:02.409667 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-05543ddf-ac2d-4568-b468-c7f00e91261d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:02.416465 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-05543ddf-ac2d-4568-b468-c7f00e91261d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:02.424634 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-05543ddf-ac2d-4568-b468-c7f00e91261d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:02.736634 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-05543ddf-ac2d-4568-b468-c7f00e91261d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:02.747146 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-05543ddf-ac2d-4568-b468-c7f00e91261d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.346557 May 12 09:40:02.748039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 314/633] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:02 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:03.348782 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-3bc2fab8-2d2d-4019-bc5e-1271446687f6 req-24d42ddb-2149-4567-837c-db09e3a8c2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ce3bd7-6835-4430-8fd7-05afeb6925fc", "tag": "0bff5673-9db4-4e7f-89c0-c77db087a526"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:03.360452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-3bc2fab8-2d2d-4019-bc5e-1271446687f6 req-24d42ddb-2149-4567-837c-db09e3a8c2a7 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:03.363268 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-3bc2fab8-2d2d-4019-bc5e-1271446687f6 req-24d42ddb-2149-4567-837c-db09e3a8c2a7 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:03.382957 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-3bc2fab8-2d2d-4019-bc5e-1271446687f6 req-24d42ddb-2149-4567-837c-db09e3a8c2a7 service nova] Creating event network-changed:0bff5673-9db4-4e7f-89c0-c77db087a526 for instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc on hv-cinder-83769 May 12 09:40:03.389376 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-3bc2fab8-2d2d-4019-bc5e-1271446687f6 req-24d42ddb-2149-4567-837c-db09e3a8c2a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044678 May 12 09:40:03.390305 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 320/634] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:03.477380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-04d878f0-d868-4635-8d36-d589e3bac3e1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:03.478172 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-04d878f0-d868-4635-8d36-d589e3bac3e1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:03.523339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-04d878f0-d868-4635-8d36-d589e3bac3e1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:03.526916 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-04d878f0-d868-4635-8d36-d589e3bac3e1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:03.528195 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-04d878f0-d868-4635-8d36-d589e3bac3e1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:03.529912 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-04d878f0-d868-4635-8d36-d589e3bac3e1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:03.715204 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-04d878f0-d868-4635-8d36-d589e3bac3e1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lazy-loading 'services' on Instance uuid a158cc80-2631-4dba-8071-ef5e07ec8ba1 {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:40:03.865100 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-04d878f0-d868-4635-8d36-d589e3bac3e1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments/d79999b1-fead-48b7-a108-9f6e6299db32" status: 202 len: 0 microversion: 2.1 time: 0.409150 May 12 09:40:03.865727 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 315/635] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:40:03 2022] DELETE /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments/d79999b1-fead-48b7-a108-9f6e6299db32 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:40:03.875190 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-08255d54-7a61-4947-ad26-4519cfbf8b25 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:03.879376 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-08255d54-7a61-4947-ad26-4519cfbf8b25 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:03.893727 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-08255d54-7a61-4947-ad26-4519cfbf8b25 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:03.894218 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-08255d54-7a61-4947-ad26-4519cfbf8b25 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:03.895015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-08255d54-7a61-4947-ad26-4519cfbf8b25 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:03.895463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-08255d54-7a61-4947-ad26-4519cfbf8b25 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:03.968897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-893fce2a-97b3-41fb-9fc9-f6acd0acbbca req-3b3c674a-fbe9-48d5-a404-068e88477319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a158cc80-2631-4dba-8071-ef5e07ec8ba1", "tag": "3af65aa8-83b2-410d-b24d-4b9b1b6dd549"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:03.984963 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-893fce2a-97b3-41fb-9fc9-f6acd0acbbca req-3b3c674a-fbe9-48d5-a404-068e88477319 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:03.985421 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-893fce2a-97b3-41fb-9fc9-f6acd0acbbca req-3b3c674a-fbe9-48d5-a404-068e88477319 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:04.014372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-893fce2a-97b3-41fb-9fc9-f6acd0acbbca req-3b3c674a-fbe9-48d5-a404-068e88477319 service nova] Creating event network-changed:3af65aa8-83b2-410d-b24d-4b9b1b6dd549 for instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 on hv-cinder-83769 May 12 09:40:04.025330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-893fce2a-97b3-41fb-9fc9-f6acd0acbbca req-3b3c674a-fbe9-48d5-a404-068e88477319 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.566370 May 12 09:40:04.027061 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 321/636] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:04.039940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b987f1df-d0b9-4f85-a5cf-a80cf391c59d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:04.045765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b987f1df-d0b9-4f85-a5cf-a80cf391c59d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:04.057796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b987f1df-d0b9-4f85-a5cf-a80cf391c59d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:04.058425 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b987f1df-d0b9-4f85-a5cf-a80cf391c59d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:04.061273 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b987f1df-d0b9-4f85-a5cf-a80cf391c59d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:04.064366 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b987f1df-d0b9-4f85-a5cf-a80cf391c59d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:04.138781 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-08255d54-7a61-4947-ad26-4519cfbf8b25 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:04.148493 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b987f1df-d0b9-4f85-a5cf-a80cf391c59d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120209 May 12 09:40:04.149087 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 322/637] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:40:04 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:04.151883 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-08255d54-7a61-4947-ad26-4519cfbf8b25 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.284707 May 12 09:40:04.155392 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 316/638] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:03 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:05.162585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bc007e44-6f99-4bc3-98ca-5a54addd0434 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:05.163811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-bc007e44-6f99-4bc3-98ca-5a54addd0434 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:05.169886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b706ec19-b9e9-4abb-bb28-1fc05d54fa71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:05.171061 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b706ec19-b9e9-4abb-bb28-1fc05d54fa71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:05.173890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bc007e44-6f99-4bc3-98ca-5a54addd0434 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:05.174806 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bc007e44-6f99-4bc3-98ca-5a54addd0434 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:05.175466 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bc007e44-6f99-4bc3-98ca-5a54addd0434 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:05.176184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bc007e44-6f99-4bc3-98ca-5a54addd0434 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:05.186869 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b706ec19-b9e9-4abb-bb28-1fc05d54fa71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:05.187590 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b706ec19-b9e9-4abb-bb28-1fc05d54fa71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:05.188587 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b706ec19-b9e9-4abb-bb28-1fc05d54fa71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:05.189191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b706ec19-b9e9-4abb-bb28-1fc05d54fa71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:05.214078 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-bc007e44-6f99-4bc3-98ca-5a54addd0434 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057333 May 12 09:40:05.215076 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 323/639] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:40:05 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:05.387015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b706ec19-b9e9-4abb-bb28-1fc05d54fa71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:05.395203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b706ec19-b9e9-4abb-bb28-1fc05d54fa71 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.230196 May 12 09:40:05.395785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 317/640] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:05 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:06.226034 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5814e63a-0761-49d6-adac-9076a84745e3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:06.227014 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5814e63a-0761-49d6-adac-9076a84745e3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:06.233405 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5814e63a-0761-49d6-adac-9076a84745e3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:06.233856 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5814e63a-0761-49d6-adac-9076a84745e3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:06.234653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5814e63a-0761-49d6-adac-9076a84745e3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:06.235591 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5814e63a-0761-49d6-adac-9076a84745e3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:06.265594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5814e63a-0761-49d6-adac-9076a84745e3 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 May 12 09:40:06.266207 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 324/641] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:40:06 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:06.411483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ab85c491-7941-4740-a444-9cf55e84e6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:06.412090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ab85c491-7941-4740-a444-9cf55e84e6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:06.419390 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ab85c491-7941-4740-a444-9cf55e84e6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:06.419839 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ab85c491-7941-4740-a444-9cf55e84e6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:06.420647 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ab85c491-7941-4740-a444-9cf55e84e6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:06.421078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ab85c491-7941-4740-a444-9cf55e84e6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:06.554300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ab85c491-7941-4740-a444-9cf55e84e6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:06.561437 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ab85c491-7941-4740-a444-9cf55e84e6a4 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.153932 May 12 09:40:06.562020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 318/642] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:06 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:07.277327 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b930bdd8-9899-4933-9c22-8657f31f9035 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:07.278266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b930bdd8-9899-4933-9c22-8657f31f9035 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:07.284519 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b930bdd8-9899-4933-9c22-8657f31f9035 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:07.284961 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b930bdd8-9899-4933-9c22-8657f31f9035 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:07.285714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b930bdd8-9899-4933-9c22-8657f31f9035 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:07.286170 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b930bdd8-9899-4933-9c22-8657f31f9035 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:07.316729 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b930bdd8-9899-4933-9c22-8657f31f9035 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043368 May 12 09:40:07.317202 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 325/643] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:40:07 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:07.579601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a8280d01-a4fd-4401-b5a5-75d3ff269920 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:07.580146 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a8280d01-a4fd-4401-b5a5-75d3ff269920 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:07.586681 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a8280d01-a4fd-4401-b5a5-75d3ff269920 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:07.587128 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a8280d01-a4fd-4401-b5a5-75d3ff269920 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:07.587889 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a8280d01-a4fd-4401-b5a5-75d3ff269920 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:07.588320 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a8280d01-a4fd-4401-b5a5-75d3ff269920 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:07.725284 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a8280d01-a4fd-4401-b5a5-75d3ff269920 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:07.732577 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a8280d01-a4fd-4401-b5a5-75d3ff269920 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.157682 May 12 09:40:07.733144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 319/644] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:07 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:08.328198 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8cf3f5cd-a4b9-4c18-aaab-2a8c9b925f38 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:08.329637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8cf3f5cd-a4b9-4c18-aaab-2a8c9b925f38 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:08.335902 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5cd-a4b9-4c18-aaab-2a8c9b925f38 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:08.336343 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5cd-a4b9-4c18-aaab-2a8c9b925f38 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:08.337094 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5cd-a4b9-4c18-aaab-2a8c9b925f38 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:08.337523 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8cf3f5cd-a4b9-4c18-aaab-2a8c9b925f38 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:08.367841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8cf3f5cd-a4b9-4c18-aaab-2a8c9b925f38 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 May 12 09:40:08.368408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 326/645] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:40:08 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:08.749538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-00f7fddb-965d-4402-818a-04d8a6c0b705 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:08.750164 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-00f7fddb-965d-4402-818a-04d8a6c0b705 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:08.756965 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00f7fddb-965d-4402-818a-04d8a6c0b705 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:08.757412 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00f7fddb-965d-4402-818a-04d8a6c0b705 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:08.758789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00f7fddb-965d-4402-818a-04d8a6c0b705 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:08.758914 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00f7fddb-965d-4402-818a-04d8a6c0b705 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:08.903367 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-00f7fddb-965d-4402-818a-04d8a6c0b705 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:08.926824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-00f7fddb-965d-4402-818a-04d8a6c0b705 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.180964 May 12 09:40:08.927452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 320/646] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:08 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:09.380055 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-acb73e65-c980-4bac-96fa-f73ad936a75b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:09.380888 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-acb73e65-c980-4bac-96fa-f73ad936a75b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:09.388130 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-acb73e65-c980-4bac-96fa-f73ad936a75b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:09.388312 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-acb73e65-c980-4bac-96fa-f73ad936a75b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:09.389028 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-acb73e65-c980-4bac-96fa-f73ad936a75b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:09.389468 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-acb73e65-c980-4bac-96fa-f73ad936a75b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:09.419936 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-acb73e65-c980-4bac-96fa-f73ad936a75b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044499 May 12 09:40:09.421234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 327/647] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:40:09 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 09:40:09.432006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:09.432492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:09.438849 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:09.439485 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:09.440241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:09.440665 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:09.513984 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] HTTP exception thrown: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 is not attached to volume d79999b1-fead-48b7-a108-9f6e6299db32 May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Request method failure captured: May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: DELETE /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments/d79999b1-fead-48b7-a108-9f6e6299db32 HTTP/1.1 May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNS3i8HeMdCj6_EllJUbqQwnAaLu0ZFdMBxmydZae6K7Y3I5LVS39de8CI79Lsh7XeziZVcXfy63VgXxQFnAnI73TubXnkXBvo69lQ2CE2fGgCiwL_QODJkzgSK81UwLf2c-KHCtU_SZlvQVCfbSYrhWIoUNKniuz4iwvteYZoZac94 May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: bdc48145acde413e99299f029ad0cea9 May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-TestMinimumBasicScenario-1619771787 May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:40:09.517006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdc48145acde413e99299f029ad0cea9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdc48145acde413e99299f029ad0cea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdc48145acde413e99299f029ad0cea9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdc48145acde413e99299f029ad0cea9"}]}] May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-TestMinimumBasicScenario-1619771787 May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: bdc48145acde413e99299f029ad0cea9 May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1619771787 May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-TestMinimumBasicScenario-1619771787-project May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 1174087be0a7412d8dbba6f4f56c3424 May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-TestMinimumBasicScenario-1619771787-project May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:40:09.518874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 is not attached to volume d79999b1-fead-48b7-a108-9f6e6299db32 May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'server_id': 'a158cc80-2631-4dba-8071-ef5e07ec8ba1', 'id': 'd79999b1-fead-48b7-a108-9f6e6299db32'} May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d79999b1-fead-48b7-a108-9f6e6299db32. May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:40:09.519929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 is not attached to volume d79999b1-fead-48b7-a108-9f6e6299db32 May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 is not attached to volume d79999b1-fead-48b7-a108-9f6e6299db32 May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:09.521292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Returning 404 to user: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 is not attached to volume d79999b1-fead-48b7-a108-9f6e6299db32 {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:40:09.522536 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3d4d31a4-e8c4-4115-ae79-e6078fdf920c tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments/d79999b1-fead-48b7-a108-9f6e6299db32" status: 404 len: 154 microversion: 2.1 time: 0.090383 May 12 09:40:09.522536 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 321/648] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:40:09 2022] DELETE /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1/os-volume_attachments/d79999b1-fead-48b7-a108-9f6e6299db32 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 09:40:09.943851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4a5996ae-024b-4007-8b94-014248bdf165 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:09.944457 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4a5996ae-024b-4007-8b94-014248bdf165 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:09.950916 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4a5996ae-024b-4007-8b94-014248bdf165 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:09.951374 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4a5996ae-024b-4007-8b94-014248bdf165 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:09.952258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4a5996ae-024b-4007-8b94-014248bdf165 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:09.952810 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4a5996ae-024b-4007-8b94-014248bdf165 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:10.086878 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4a5996ae-024b-4007-8b94-014248bdf165 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:10.094793 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4a5996ae-024b-4007-8b94-014248bdf165 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.154090 May 12 09:40:10.095377 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 328/649] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:09 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:10.363462 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-b92d2b35-d720-4708-aa0c-89a0de74dc07 req-b06ce5b3-5c64-4534-a0cc-2eb48a9721de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ce3bd7-6835-4430-8fd7-05afeb6925fc", "name": "network-vif-plugged", "status": "completed", "tag": "0bff5673-9db4-4e7f-89c0-c77db087a526"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:10.372498 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-b92d2b35-d720-4708-aa0c-89a0de74dc07 req-b06ce5b3-5c64-4534-a0cc-2eb48a9721de service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:10.372947 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-b92d2b35-d720-4708-aa0c-89a0de74dc07 req-b06ce5b3-5c64-4534-a0cc-2eb48a9721de service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:10.383942 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-b92d2b35-d720-4708-aa0c-89a0de74dc07 req-b06ce5b3-5c64-4534-a0cc-2eb48a9721de service nova] Creating event network-vif-plugged:0bff5673-9db4-4e7f-89c0-c77db087a526 for instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc on hv-cinder-83769 May 12 09:40:10.389088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-b92d2b35-d720-4708-aa0c-89a0de74dc07 req-b06ce5b3-5c64-4534-a0cc-2eb48a9721de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092466 May 12 09:40:10.389733 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 322/650] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:10.650254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c29fe92c-b93b-4487-aa99-2388ee008acc tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:10.650771 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c29fe92c-b93b-4487-aa99-2388ee008acc tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:10.657216 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c29fe92c-b93b-4487-aa99-2388ee008acc tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:10.657671 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c29fe92c-b93b-4487-aa99-2388ee008acc tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:10.658815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c29fe92c-b93b-4487-aa99-2388ee008acc tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:10.659259 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c29fe92c-b93b-4487-aa99-2388ee008acc tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:10.686038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c29fe92c-b93b-4487-aa99-2388ee008acc tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:40:10.760884 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c29fe92c-b93b-4487-aa99-2388ee008acc tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 204 len: 0 microversion: 2.1 time: 0.114200 May 12 09:40:10.761748 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 329/651] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:40:10 2022] DELETE /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:40:10.770622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-67f9b72b-a17a-4ffe-b562-e8a86d7250b1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:10.771307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-67f9b72b-a17a-4ffe-b562-e8a86d7250b1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:10.777633 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67f9b72b-a17a-4ffe-b562-e8a86d7250b1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:10.778125 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67f9b72b-a17a-4ffe-b562-e8a86d7250b1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:10.778908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67f9b72b-a17a-4ffe-b562-e8a86d7250b1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:10.779351 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67f9b72b-a17a-4ffe-b562-e8a86d7250b1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:10.908292 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-67f9b72b-a17a-4ffe-b562-e8a86d7250b1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:10.915737 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-67f9b72b-a17a-4ffe-b562-e8a86d7250b1 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1553 microversion: 2.1 time: 0.149606 May 12 09:40:10.916304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 323/652] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:10 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:11.112948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2617e45e-533f-42a5-af7b-ab83f0e689ee tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:11.113647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2617e45e-533f-42a5-af7b-ab83f0e689ee tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:11.119648 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2617e45e-533f-42a5-af7b-ab83f0e689ee tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:11.120095 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2617e45e-533f-42a5-af7b-ab83f0e689ee tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:11.120857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2617e45e-533f-42a5-af7b-ab83f0e689ee tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:11.121290 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2617e45e-533f-42a5-af7b-ab83f0e689ee tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:11.257049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2617e45e-533f-42a5-af7b-ab83f0e689ee tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:11.265083 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2617e45e-533f-42a5-af7b-ab83f0e689ee tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.156943 May 12 09:40:11.265888 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 330/653] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:11 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:11.932609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-53fc1679-3efe-4437-bf65-42df0248a33b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:11.933224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-53fc1679-3efe-4437-bf65-42df0248a33b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:11.939558 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-53fc1679-3efe-4437-bf65-42df0248a33b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:11.940013 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-53fc1679-3efe-4437-bf65-42df0248a33b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:11.940779 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-53fc1679-3efe-4437-bf65-42df0248a33b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:11.941223 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-53fc1679-3efe-4437-bf65-42df0248a33b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:12.079822 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-53fc1679-3efe-4437-bf65-42df0248a33b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:12.087157 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-53fc1679-3efe-4437-bf65-42df0248a33b tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1553 microversion: 2.1 time: 0.158621 May 12 09:40:12.087725 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 324/654] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:11 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:12.282852 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ae09766c-de58-4a0e-a55b-1af816dd6c9f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:12.283385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ae09766c-de58-4a0e-a55b-1af816dd6c9f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:12.289689 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ae09766c-de58-4a0e-a55b-1af816dd6c9f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:12.290172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ae09766c-de58-4a0e-a55b-1af816dd6c9f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:12.290933 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ae09766c-de58-4a0e-a55b-1af816dd6c9f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:12.291363 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ae09766c-de58-4a0e-a55b-1af816dd6c9f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:12.423360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ae09766c-de58-4a0e-a55b-1af816dd6c9f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:12.431066 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ae09766c-de58-4a0e-a55b-1af816dd6c9f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.152041 May 12 09:40:12.431670 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 331/655] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:12 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:40:13.104041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7012fd5a-a28f-42ec-b4a3-25b8aa077807 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:13.104624 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7012fd5a-a28f-42ec-b4a3-25b8aa077807 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:13.110964 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7012fd5a-a28f-42ec-b4a3-25b8aa077807 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:13.111413 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7012fd5a-a28f-42ec-b4a3-25b8aa077807 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:13.112171 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7012fd5a-a28f-42ec-b4a3-25b8aa077807 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:13.112605 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7012fd5a-a28f-42ec-b4a3-25b8aa077807 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:13.238958 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7012fd5a-a28f-42ec-b4a3-25b8aa077807 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:13.246256 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7012fd5a-a28f-42ec-b4a3-25b8aa077807 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1553 microversion: 2.1 time: 0.146157 May 12 09:40:13.246826 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 325/656] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:13 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1553 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:13.449147 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-36ff23b4-086b-4dc5-a23d-37e6ef77e4c6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:13.449693 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-36ff23b4-086b-4dc5-a23d-37e6ef77e4c6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:13.457593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36ff23b4-086b-4dc5-a23d-37e6ef77e4c6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:13.458215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36ff23b4-086b-4dc5-a23d-37e6ef77e4c6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:13.459051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36ff23b4-086b-4dc5-a23d-37e6ef77e4c6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:13.459516 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36ff23b4-086b-4dc5-a23d-37e6ef77e4c6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:13.615865 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-36ff23b4-086b-4dc5-a23d-37e6ef77e4c6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:13.623005 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-36ff23b4-086b-4dc5-a23d-37e6ef77e4c6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.177863 May 12 09:40:13.623562 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 332/657] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:13 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:14.265164 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-837c1245-82b3-4746-a8bd-1bf4ca013a1d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:14.265767 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-837c1245-82b3-4746-a8bd-1bf4ca013a1d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:14.272029 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-837c1245-82b3-4746-a8bd-1bf4ca013a1d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:14.272477 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-837c1245-82b3-4746-a8bd-1bf4ca013a1d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:14.273240 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-837c1245-82b3-4746-a8bd-1bf4ca013a1d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:14.273672 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-837c1245-82b3-4746-a8bd-1bf4ca013a1d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:14.410837 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-837c1245-82b3-4746-a8bd-1bf4ca013a1d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:14.418377 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-837c1245-82b3-4746-a8bd-1bf4ca013a1d tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1553 microversion: 2.1 time: 0.156993 May 12 09:40:14.418957 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 326/658] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:14 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:14.640230 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3c85d98f-35ce-4667-8143-0abbaef1c918 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:14.640778 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3c85d98f-35ce-4667-8143-0abbaef1c918 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:14.647066 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3c85d98f-35ce-4667-8143-0abbaef1c918 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:14.647514 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3c85d98f-35ce-4667-8143-0abbaef1c918 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:14.648279 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3c85d98f-35ce-4667-8143-0abbaef1c918 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:14.648712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3c85d98f-35ce-4667-8143-0abbaef1c918 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:14.779629 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3c85d98f-35ce-4667-8143-0abbaef1c918 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:14.787487 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3c85d98f-35ce-4667-8143-0abbaef1c918 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1366 microversion: 2.1 time: 0.151176 May 12 09:40:14.788052 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 333/659] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:14 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:15.435720 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-269fbccd-9601-406d-af5c-fa6e7ea48142 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:15.436483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-269fbccd-9601-406d-af5c-fa6e7ea48142 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:15.443695 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-269fbccd-9601-406d-af5c-fa6e7ea48142 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:15.444160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-269fbccd-9601-406d-af5c-fa6e7ea48142 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:15.444985 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-269fbccd-9601-406d-af5c-fa6e7ea48142 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:15.445430 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-269fbccd-9601-406d-af5c-fa6e7ea48142 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:15.518790 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-269fbccd-9601-406d-af5c-fa6e7ea48142 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1174087be0a7412d8dbba6f4f56c3424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc48145acde413e99299f029ad0cea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:15.526239 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-269fbccd-9601-406d-af5c-fa6e7ea48142 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 200 len: 1511 microversion: 2.1 time: 0.094344 May 12 09:40:15.526816 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 327/660] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:15 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 1511 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:15.606885 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-336cb6d7-c423-4442-a273-0c0b9540a39d req-33ba4684-5609-47ae-bbc3-95614a0317f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a158cc80-2631-4dba-8071-ef5e07ec8ba1", "name": "network-vif-deleted", "tag": "3af65aa8-83b2-410d-b24d-4b9b1b6dd549"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:15.615564 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-336cb6d7-c423-4442-a273-0c0b9540a39d req-33ba4684-5609-47ae-bbc3-95614a0317f3 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:15.616008 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-336cb6d7-c423-4442-a273-0c0b9540a39d req-33ba4684-5609-47ae-bbc3-95614a0317f3 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:15.628137 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-336cb6d7-c423-4442-a273-0c0b9540a39d req-33ba4684-5609-47ae-bbc3-95614a0317f3 service nova] Creating event network-vif-deleted:3af65aa8-83b2-410d-b24d-4b9b1b6dd549 for instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 on hv-cinder-83769 May 12 09:40:15.632999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-336cb6d7-c423-4442-a273-0c0b9540a39d req-33ba4684-5609-47ae-bbc3-95614a0317f3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029840 May 12 09:40:15.634584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 334/661] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:15.804532 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-80e9a0c1-2c8c-442f-9a52-9592f0943656 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:15.805458 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-80e9a0c1-2c8c-442f-9a52-9592f0943656 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:15.811911 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80e9a0c1-2c8c-442f-9a52-9592f0943656 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:15.812391 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80e9a0c1-2c8c-442f-9a52-9592f0943656 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:15.813170 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80e9a0c1-2c8c-442f-9a52-9592f0943656 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:15.813603 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80e9a0c1-2c8c-442f-9a52-9592f0943656 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:15.946326 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-80e9a0c1-2c8c-442f-9a52-9592f0943656 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:15.954232 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-80e9a0c1-2c8c-442f-9a52-9592f0943656 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1556 microversion: 2.1 time: 0.153570 May 12 09:40:15.954793 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 328/662] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:15 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:15.972735 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-fffc2df1-b756-4906-b353-bfa2dd4252e9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:15.973329 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-fffc2df1-b756-4906-b353-bfa2dd4252e9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:15.979522 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fffc2df1-b756-4906-b353-bfa2dd4252e9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:15.979999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fffc2df1-b756-4906-b353-bfa2dd4252e9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:15.980744 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fffc2df1-b756-4906-b353-bfa2dd4252e9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:15.981182 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fffc2df1-b756-4906-b353-bfa2dd4252e9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:16.059607 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-fffc2df1-b756-4906-b353-bfa2dd4252e9 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092587 May 12 09:40:16.060204 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 335/663] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 12 09:40:15 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:16.543918 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:16.544759 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] [instance: a158cc80-2631-4dba-8071-ef5e07ec8ba1] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:16.551597 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:16.552145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:16.553052 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:16.553553 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:16.568646 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] HTTP exception thrown: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 could not be found. May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Request method failure captured: May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 HTTP/1.1 May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNS3i8HeMdCj6_EllJUbqQwnAaLu0ZFdMBxmydZae6K7Y3I5LVS39de8CI79Lsh7XeziZVcXfy63VgXxQFnAnI73TubXnkXBvo69lQ2CE2fGgCiwL_QODJkzgSK81UwLf2c-KHCtU_SZlvQVCfbSYrhWIoUNKniuz4iwvteYZoZac94 May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: bdc48145acde413e99299f029ad0cea9 May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-TestMinimumBasicScenario-1619771787 May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:40:16.570447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_bdc48145acde413e99299f029ad0cea9", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdc48145acde413e99299f029ad0cea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/bdc48145acde413e99299f029ad0cea9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/bdc48145acde413e99299f029ad0cea9"}]}] May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-TestMinimumBasicScenario-1619771787 May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: bdc48145acde413e99299f029ad0cea9 May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1619771787 May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-TestMinimumBasicScenario-1619771787-project May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 1174087be0a7412d8dbba6f4f56c3424 May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-TestMinimumBasicScenario-1619771787-project May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 could not be found. May 12 09:40:16.572053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'a158cc80-2631-4dba-8071-ef5e07ec8ba1'} May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 could not be found. May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:40:16.573117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 could not be found. May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 could not be found. May 12 09:40:16.574648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:40:16.576080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Returning 404 to user: Instance a158cc80-2631-4dba-8071-ef5e07ec8ba1 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:40:16.576080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c9e3e7bf-9355-49e6-ade8-dfd83dad5890 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1" status: 404 len: 111 microversion: 2.1 time: 0.033375 May 12 09:40:16.577297 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 329/664] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:16 2022] GET /compute/v2.1/servers/a158cc80-2631-4dba-8071-ef5e07ec8ba1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:40:16.583707 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-44940c43-36e9-4876-8cda-219e4b35f9c9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] Calling method '.version_select at 0x7f8725737dc0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:16.603436 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-44940c43-36e9-4876-8cda-219e4b35f9c9 tempest-TestMinimumBasicScenario-1619771787 tempest-TestMinimumBasicScenario-1619771787-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-554626583" status: 202 len: 0 microversion: 2.1 time: 0.023458 May 12 09:40:16.604301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 336/665] 10.222.0.60 () {58 vars in 1268 bytes} [Thu May 12 09:40:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-554626583 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:40:17.650995 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-098e60a5-e120-4552-8324-b954c249380e req-62d7e19c-ad22-48d7-9c2b-58811643d4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ce3bd7-6835-4430-8fd7-05afeb6925fc", "tag": "0bff5673-9db4-4e7f-89c0-c77db087a526"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:17.660998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-098e60a5-e120-4552-8324-b954c249380e req-62d7e19c-ad22-48d7-9c2b-58811643d4dc service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:17.661720 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-098e60a5-e120-4552-8324-b954c249380e req-62d7e19c-ad22-48d7-9c2b-58811643d4dc service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:17.673846 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-098e60a5-e120-4552-8324-b954c249380e req-62d7e19c-ad22-48d7-9c2b-58811643d4dc service nova] Creating event network-changed:0bff5673-9db4-4e7f-89c0-c77db087a526 for instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc on hv-cinder-83769 May 12 09:40:17.679477 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-098e60a5-e120-4552-8324-b954c249380e req-62d7e19c-ad22-48d7-9c2b-58811643d4dc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032054 May 12 09:40:17.680685 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 330/666] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:31.101288 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-689504631", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1560436604", "security_groups": [{"name": "tempest-secgroup-smoke-1184495859"}], "networks": [{"uuid": "1fcc80ff-8e1d-4af6-9047-57b5fbbc9180"}], "block_device_mapping_v2": [{"uuid": "89840de7-9ca1-4087-b08b-ada49ef65c75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:31.208129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] validate_networks() for [('1fcc80ff-8e1d-4af6-9047-57b5fbbc9180', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:40:31.706963 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:40:31.707388 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:40:31.707860 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:40:31.708269 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:40:31.708677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:40:31.717190 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:31.717635 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:31.718977 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:31.719410 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:31.736151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Getting quotas for project 170aaa04d8fe4170bf344d5667ae2814. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:40:31.739951 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Getting quotas for user fde21f628031431583e085d26485451d and project 170aaa04d8fe4170bf344d5667ae2814. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:40:31.795370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:40:31.798127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89840de7-9ca1-4087-b08b-ada49ef65c75',volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:40:31.918886 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [3269bd5b-1c2a-4d87-9b57-0d092453292b] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 09:40:32.926638 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [3269bd5b-1c2a-4d87-9b57-0d092453292b] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 34246. May 12 09:40:32.930973 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-dd1b0145-7ceb-4342-8013-9e6f2e97c234 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.834186 May 12 09:40:32.931614 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 337/667] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:40:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:40:32.943141 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ba6055e1-3c7b-4320-934b-47ce906a4414 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:32.943840 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ba6055e1-3c7b-4320-934b-47ce906a4414 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:32.995264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ba6055e1-3c7b-4320-934b-47ce906a4414 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:33.002197 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ba6055e1-3c7b-4320-934b-47ce906a4414 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1088 microversion: 2.1 time: 0.064401 May 12 09:40:33.002858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 331/668] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:32 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:34.023542 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8e9c411e-a92a-471b-b17d-6b2ca572b7ec tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:34.024170 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8e9c411e-a92a-471b-b17d-6b2ca572b7ec tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:34.031563 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e9c411e-a92a-471b-b17d-6b2ca572b7ec tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:34.032020 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e9c411e-a92a-471b-b17d-6b2ca572b7ec tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:34.032882 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e9c411e-a92a-471b-b17d-6b2ca572b7ec tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:34.033323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e9c411e-a92a-471b-b17d-6b2ca572b7ec tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:34.096121 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8e9c411e-a92a-471b-b17d-6b2ca572b7ec tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:34.103540 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8e9c411e-a92a-471b-b17d-6b2ca572b7ec tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1204 microversion: 2.1 time: 0.087825 May 12 09:40:34.104328 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 338/669] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:34 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:40:35.120566 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f27ea730-0b24-41ea-9178-3e3cffcbb1d5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:35.121275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f27ea730-0b24-41ea-9178-3e3cffcbb1d5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:35.129260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f27ea730-0b24-41ea-9178-3e3cffcbb1d5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:35.129796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f27ea730-0b24-41ea-9178-3e3cffcbb1d5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:35.130610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f27ea730-0b24-41ea-9178-3e3cffcbb1d5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:35.131051 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f27ea730-0b24-41ea-9178-3e3cffcbb1d5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:35.334400 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f27ea730-0b24-41ea-9178-3e3cffcbb1d5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:35.341677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f27ea730-0b24-41ea-9178-3e3cffcbb1d5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.224986 May 12 09:40:35.342275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 332/670] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:35 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:35.681517 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-153975ac-85c2-4264-954e-2685d48513c2 req-77ff5132-b631-4b69-a94a-beca60d817b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5697f44b-088d-48ee-89a1-ae6d09f7d47f", "tag": "24fe4aa4-21d7-4953-acd5-384b86945694"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:35.690818 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-153975ac-85c2-4264-954e-2685d48513c2 req-77ff5132-b631-4b69-a94a-beca60d817b5 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:35.691568 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-153975ac-85c2-4264-954e-2685d48513c2 req-77ff5132-b631-4b69-a94a-beca60d817b5 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:35.703973 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-153975ac-85c2-4264-954e-2685d48513c2 req-77ff5132-b631-4b69-a94a-beca60d817b5 service nova] Creating event network-changed:24fe4aa4-21d7-4953-acd5-384b86945694 for instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f on hv-cinder-83769 May 12 09:40:35.710097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-153975ac-85c2-4264-954e-2685d48513c2 req-77ff5132-b631-4b69-a94a-beca60d817b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032230 May 12 09:40:35.710727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 339/671] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:40:36.358828 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2284efda-0ead-4ce3-91eb-9b122659ac6a tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:36.359419 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2284efda-0ead-4ce3-91eb-9b122659ac6a tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:36.366207 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2284efda-0ead-4ce3-91eb-9b122659ac6a tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:36.366653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2284efda-0ead-4ce3-91eb-9b122659ac6a tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:36.367408 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2284efda-0ead-4ce3-91eb-9b122659ac6a tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:36.367838 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2284efda-0ead-4ce3-91eb-9b122659ac6a tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:36.494337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2284efda-0ead-4ce3-91eb-9b122659ac6a tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:36.501924 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2284efda-0ead-4ce3-91eb-9b122659ac6a tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.146687 May 12 09:40:36.502490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 333/672] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:36 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:37.519584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4e94537f-8d59-4325-b0bc-8b615d776c38 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:37.520278 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4e94537f-8d59-4325-b0bc-8b615d776c38 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:37.526475 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e94537f-8d59-4325-b0bc-8b615d776c38 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:37.526927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e94537f-8d59-4325-b0bc-8b615d776c38 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:37.527688 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e94537f-8d59-4325-b0bc-8b615d776c38 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:37.528124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e94537f-8d59-4325-b0bc-8b615d776c38 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:37.661360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4e94537f-8d59-4325-b0bc-8b615d776c38 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:37.668786 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4e94537f-8d59-4325-b0bc-8b615d776c38 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.154297 May 12 09:40:37.669364 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 340/673] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:37 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:38.684840 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3a3b299b-c9d2-4bc2-bbd5-fdc816bdfa34 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:38.685432 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3a3b299b-c9d2-4bc2-bbd5-fdc816bdfa34 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:38.691778 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3a3b299b-c9d2-4bc2-bbd5-fdc816bdfa34 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:38.692229 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3a3b299b-c9d2-4bc2-bbd5-fdc816bdfa34 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:38.692997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3a3b299b-c9d2-4bc2-bbd5-fdc816bdfa34 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:38.693435 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3a3b299b-c9d2-4bc2-bbd5-fdc816bdfa34 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:38.826218 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-3a3b299b-c9d2-4bc2-bbd5-fdc816bdfa34 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:38.834060 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3a3b299b-c9d2-4bc2-bbd5-fdc816bdfa34 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.153146 May 12 09:40:38.834628 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 334/674] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:38 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:39.643391 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:40:39.643628 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Thu May 12 09:40:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:40:39.850041 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a14fcd70-3d0c-4904-94e1-a70315bd71d8 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:39.850621 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a14fcd70-3d0c-4904-94e1-a70315bd71d8 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:39.856560 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a14fcd70-3d0c-4904-94e1-a70315bd71d8 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:39.857007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a14fcd70-3d0c-4904-94e1-a70315bd71d8 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:39.857760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a14fcd70-3d0c-4904-94e1-a70315bd71d8 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:39.858215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a14fcd70-3d0c-4904-94e1-a70315bd71d8 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:39.983014 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a14fcd70-3d0c-4904-94e1-a70315bd71d8 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:39.990797 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a14fcd70-3d0c-4904-94e1-a70315bd71d8 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.144751 May 12 09:40:39.991365 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 341/675] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:39 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:41.008018 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-31c80746-2e81-4f92-9797-34ba6ca41f84 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:41.008875 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-31c80746-2e81-4f92-9797-34ba6ca41f84 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:41.015339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31c80746-2e81-4f92-9797-34ba6ca41f84 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:41.015786 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31c80746-2e81-4f92-9797-34ba6ca41f84 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:41.016544 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31c80746-2e81-4f92-9797-34ba6ca41f84 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:41.016978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-31c80746-2e81-4f92-9797-34ba6ca41f84 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:41.150967 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-31c80746-2e81-4f92-9797-34ba6ca41f84 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:41.158134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-31c80746-2e81-4f92-9797-34ba6ca41f84 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.153924 May 12 09:40:41.158751 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 335/676] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:41 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:42.175443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-de27a9f6-56d1-4929-b64c-c75238e217dc tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:42.176602 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-de27a9f6-56d1-4929-b64c-c75238e217dc tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:42.184248 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-de27a9f6-56d1-4929-b64c-c75238e217dc tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:42.184704 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-de27a9f6-56d1-4929-b64c-c75238e217dc tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:42.185466 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-de27a9f6-56d1-4929-b64c-c75238e217dc tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:42.185919 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-de27a9f6-56d1-4929-b64c-c75238e217dc tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:42.321537 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-de27a9f6-56d1-4929-b64c-c75238e217dc tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:42.328921 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-de27a9f6-56d1-4929-b64c-c75238e217dc tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.157619 May 12 09:40:42.329489 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 342/677] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:42 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:43.345497 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-231f963b-5bb5-4739-bf6b-ec981eb990fb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:43.346760 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-231f963b-5bb5-4739-bf6b-ec981eb990fb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:43.352987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-231f963b-5bb5-4739-bf6b-ec981eb990fb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:43.353438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-231f963b-5bb5-4739-bf6b-ec981eb990fb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:43.354236 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-231f963b-5bb5-4739-bf6b-ec981eb990fb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:43.354679 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-231f963b-5bb5-4739-bf6b-ec981eb990fb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:43.479362 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-231f963b-5bb5-4739-bf6b-ec981eb990fb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:43.486629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-231f963b-5bb5-4739-bf6b-ec981eb990fb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.144958 May 12 09:40:43.487187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 336/678] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:43 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:44.503400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-95771ec1-8b5a-49db-8456-7e2de2a1237c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:44.504091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-95771ec1-8b5a-49db-8456-7e2de2a1237c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:44.511148 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-95771ec1-8b5a-49db-8456-7e2de2a1237c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:44.511606 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-95771ec1-8b5a-49db-8456-7e2de2a1237c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:44.512389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-95771ec1-8b5a-49db-8456-7e2de2a1237c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:44.512829 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-95771ec1-8b5a-49db-8456-7e2de2a1237c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:44.643582 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-95771ec1-8b5a-49db-8456-7e2de2a1237c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:44.650783 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-95771ec1-8b5a-49db-8456-7e2de2a1237c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.151325 May 12 09:40:44.651347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 343/679] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:44 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:45.667764 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-76ca41bb-3db2-4ae9-a91f-1dffa9f9efbb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:45.668321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-76ca41bb-3db2-4ae9-a91f-1dffa9f9efbb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:45.674239 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-76ca41bb-3db2-4ae9-a91f-1dffa9f9efbb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:45.674691 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-76ca41bb-3db2-4ae9-a91f-1dffa9f9efbb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:45.675452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-76ca41bb-3db2-4ae9-a91f-1dffa9f9efbb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:45.675897 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-76ca41bb-3db2-4ae9-a91f-1dffa9f9efbb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:45.801093 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-76ca41bb-3db2-4ae9-a91f-1dffa9f9efbb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:45.808275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-76ca41bb-3db2-4ae9-a91f-1dffa9f9efbb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.144493 May 12 09:40:45.808832 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 337/680] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:45 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:46.824297 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-34e07267-f568-4807-bc6a-b4c1756a3859 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:46.824897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-34e07267-f568-4807-bc6a-b4c1756a3859 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:46.831245 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-34e07267-f568-4807-bc6a-b4c1756a3859 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:46.831689 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-34e07267-f568-4807-bc6a-b4c1756a3859 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:46.832447 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-34e07267-f568-4807-bc6a-b4c1756a3859 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:46.832879 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-34e07267-f568-4807-bc6a-b4c1756a3859 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:46.967319 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-34e07267-f568-4807-bc6a-b4c1756a3859 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:46.975044 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-34e07267-f568-4807-bc6a-b4c1756a3859 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.154540 May 12 09:40:46.975601 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 344/681] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:46 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:47.012693 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-c21521f8-de45-4320-bfa5-b776606efdad req-15030963-9eec-40f2-9939-94951b114450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5697f44b-088d-48ee-89a1-ae6d09f7d47f", "name": "network-vif-plugged", "status": "completed", "tag": "24fe4aa4-21d7-4953-acd5-384b86945694"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:47.022352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-c21521f8-de45-4320-bfa5-b776606efdad req-15030963-9eec-40f2-9939-94951b114450 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:47.022801 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-c21521f8-de45-4320-bfa5-b776606efdad req-15030963-9eec-40f2-9939-94951b114450 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:47.034564 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-c21521f8-de45-4320-bfa5-b776606efdad req-15030963-9eec-40f2-9939-94951b114450 service nova] Creating event network-vif-plugged:24fe4aa4-21d7-4953-acd5-384b86945694 for instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f on hv-cinder-83769 May 12 09:40:47.039951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-c21521f8-de45-4320-bfa5-b776606efdad req-15030963-9eec-40f2-9939-94951b114450 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 May 12 09:40:47.040708 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 338/682] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:40:47.992254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-86e4450c-3a17-4815-a32a-341567debee1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:47.992850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-86e4450c-3a17-4815-a32a-341567debee1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:47.999295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86e4450c-3a17-4815-a32a-341567debee1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:47.999750 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86e4450c-3a17-4815-a32a-341567debee1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:48.000506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86e4450c-3a17-4815-a32a-341567debee1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:48.000943 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-86e4450c-3a17-4815-a32a-341567debee1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:48.136264 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-86e4450c-3a17-4815-a32a-341567debee1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:48.143477 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-86e4450c-3a17-4815-a32a-341567debee1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.155105 May 12 09:40:48.144038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 345/683] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:47 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:49.161020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0b3e71c0-75ce-4c2e-86b6-edf2e192454f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:49.161723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0b3e71c0-75ce-4c2e-86b6-edf2e192454f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:49.167861 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0b3e71c0-75ce-4c2e-86b6-edf2e192454f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:49.168314 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0b3e71c0-75ce-4c2e-86b6-edf2e192454f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:49.169070 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0b3e71c0-75ce-4c2e-86b6-edf2e192454f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:49.169506 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0b3e71c0-75ce-4c2e-86b6-edf2e192454f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:49.301608 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0b3e71c0-75ce-4c2e-86b6-edf2e192454f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:49.308835 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0b3e71c0-75ce-4c2e-86b6-edf2e192454f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1260 microversion: 2.1 time: 0.152633 May 12 09:40:49.309387 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 339/684] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:49 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:50.324380 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8aa14fd2-fc1b-4fdd-9221-2861adb71130 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:50.324981 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8aa14fd2-fc1b-4fdd-9221-2861adb71130 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:50.331713 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8aa14fd2-fc1b-4fdd-9221-2861adb71130 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:50.332157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8aa14fd2-fc1b-4fdd-9221-2861adb71130 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:50.332911 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8aa14fd2-fc1b-4fdd-9221-2861adb71130 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:50.333344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8aa14fd2-fc1b-4fdd-9221-2861adb71130 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:50.466424 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8aa14fd2-fc1b-4fdd-9221-2861adb71130 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:50.473611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8aa14fd2-fc1b-4fdd-9221-2861adb71130 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1443 microversion: 2.1 time: 0.153061 May 12 09:40:50.474210 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 346/685] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:50 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:50.489194 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b487f271-38cd-4b38-b9e2-192865df8b0d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:40:50.489793 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b487f271-38cd-4b38-b9e2-192865df8b0d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:40:50.495960 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b487f271-38cd-4b38-b9e2-192865df8b0d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:50.496396 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b487f271-38cd-4b38-b9e2-192865df8b0d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:50.497143 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b487f271-38cd-4b38-b9e2-192865df8b0d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:50.497571 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b487f271-38cd-4b38-b9e2-192865df8b0d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:50.626388 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b487f271-38cd-4b38-b9e2-192865df8b0d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:40:50.634372 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b487f271-38cd-4b38-b9e2-192865df8b0d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1443 microversion: 2.1 time: 0.148907 May 12 09:40:50.634926 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 340/686] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:40:50 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:40:52.586128 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-97f0e2e3-dd8f-4c68-b574-052eee787800 req-291c178a-74a6-4b29-863a-6cd941802424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5697f44b-088d-48ee-89a1-ae6d09f7d47f", "tag": "24fe4aa4-21d7-4953-acd5-384b86945694"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:40:52.594285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-97f0e2e3-dd8f-4c68-b574-052eee787800 req-291c178a-74a6-4b29-863a-6cd941802424 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:40:52.594728 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-97f0e2e3-dd8f-4c68-b574-052eee787800 req-291c178a-74a6-4b29-863a-6cd941802424 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:40:52.605077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-97f0e2e3-dd8f-4c68-b574-052eee787800 req-291c178a-74a6-4b29-863a-6cd941802424 service nova] Creating event network-changed:24fe4aa4-21d7-4953-acd5-384b86945694 for instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f on hv-cinder-83769 May 12 09:40:52.612408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-97f0e2e3-dd8f-4c68-b574-052eee787800 req-291c178a-74a6-4b29-863a-6cd941802424 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029923 May 12 09:40:52.613002 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 347/687] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:41:03.981378 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-33a73821-4744-4c13-add0-3debe8f7a9b8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c5a5735-ebd5-4659-8e32-ee1dcad04354"}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:41:03.982447 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-33a73821-4744-4c13-add0-3debe8f7a9b8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:03.988116 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-33a73821-4744-4c13-add0-3debe8f7a9b8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:03.988555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-33a73821-4744-4c13-add0-3debe8f7a9b8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:03.989303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-33a73821-4744-4c13-add0-3debe8f7a9b8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:03.989731 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-33a73821-4744-4c13-add0-3debe8f7a9b8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:04.246925 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-33a73821-4744-4c13-add0-3debe8f7a9b8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424478 May 12 09:41:04.247721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 341/688] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:41:03 2022] POST /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:41:11.716818 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-597136f8-52e7-42b8-97a6-5b46c0b5ca45 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:41:11.717869 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-597136f8-52e7-42b8-97a6-5b46c0b5ca45 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:11.724817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-597136f8-52e7-42b8-97a6-5b46c0b5ca45 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:11.725332 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-597136f8-52e7-42b8-97a6-5b46c0b5ca45 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:11.726394 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-597136f8-52e7-42b8-97a6-5b46c0b5ca45 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:11.727010 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-597136f8-52e7-42b8-97a6-5b46c0b5ca45 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:11.749389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-597136f8-52e7-42b8-97a6-5b46c0b5ca45 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lazy-loading 'flavor' on Instance uuid 7801a053-99b6-4a9b-9962-1620c14aac30 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:41:11.868601 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-597136f8-52e7-42b8-97a6-5b46c0b5ca45 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/action" status: 200 len: 32 microversion: 2.1 time: 0.156548 May 12 09:41:11.869205 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 348/689] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:41:11 2022] POST /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 09:41:11.879104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e583eb57-6839-48ac-9806-85b8134c02e1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:11.879796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e583eb57-6839-48ac-9806-85b8134c02e1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:11.886196 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e583eb57-6839-48ac-9806-85b8134c02e1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:11.886647 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e583eb57-6839-48ac-9806-85b8134c02e1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:11.887410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e583eb57-6839-48ac-9806-85b8134c02e1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:11.887842 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e583eb57-6839-48ac-9806-85b8134c02e1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:12.098001 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e583eb57-6839-48ac-9806-85b8134c02e1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:12.108646 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e583eb57-6839-48ac-9806-85b8134c02e1 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.234113 May 12 09:41:12.109302 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 342/690] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:11 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:13.126874 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7986e36d-616d-4649-81b0-1ba147f4f770 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:13.127496 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7986e36d-616d-4649-81b0-1ba147f4f770 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:13.133991 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7986e36d-616d-4649-81b0-1ba147f4f770 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:13.134378 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7986e36d-616d-4649-81b0-1ba147f4f770 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:13.135132 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7986e36d-616d-4649-81b0-1ba147f4f770 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:13.135558 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7986e36d-616d-4649-81b0-1ba147f4f770 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:13.263772 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7986e36d-616d-4649-81b0-1ba147f4f770 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:13.271849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7986e36d-616d-4649-81b0-1ba147f4f770 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.149688 May 12 09:41:13.272405 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 349/691] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:13 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:14.289922 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-cbe19fa7-ccad-421b-bf8d-9fbc9717f098 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:14.290661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-cbe19fa7-ccad-421b-bf8d-9fbc9717f098 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:14.296998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cbe19fa7-ccad-421b-bf8d-9fbc9717f098 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:14.297429 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cbe19fa7-ccad-421b-bf8d-9fbc9717f098 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:14.298224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cbe19fa7-ccad-421b-bf8d-9fbc9717f098 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:14.299005 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cbe19fa7-ccad-421b-bf8d-9fbc9717f098 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:14.422744 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cbe19fa7-ccad-421b-bf8d-9fbc9717f098 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:14.430474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-cbe19fa7-ccad-421b-bf8d-9fbc9717f098 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.144696 May 12 09:41:14.431041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 343/692] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:14 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:41:15.447694 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-adaed11a-1da0-428e-bd3d-453271820244 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:15.448273 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-adaed11a-1da0-428e-bd3d-453271820244 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:15.455267 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-adaed11a-1da0-428e-bd3d-453271820244 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:15.455707 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-adaed11a-1da0-428e-bd3d-453271820244 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:15.456460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-adaed11a-1da0-428e-bd3d-453271820244 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:15.456889 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-adaed11a-1da0-428e-bd3d-453271820244 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:15.588027 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-adaed11a-1da0-428e-bd3d-453271820244 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:15.595709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-adaed11a-1da0-428e-bd3d-453271820244 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.151841 May 12 09:41:15.596274 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 350/693] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:15 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:16.613131 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5cf4c4f3-745c-4552-88a2-0bf9bbd3d63e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:16.613725 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5cf4c4f3-745c-4552-88a2-0bf9bbd3d63e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:16.620001 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5cf4c4f3-745c-4552-88a2-0bf9bbd3d63e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:16.620452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5cf4c4f3-745c-4552-88a2-0bf9bbd3d63e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:16.621214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5cf4c4f3-745c-4552-88a2-0bf9bbd3d63e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:16.621653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5cf4c4f3-745c-4552-88a2-0bf9bbd3d63e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:16.688553 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-06e1aff1-85d7-49d0-aea0-98c11e19e2f7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:16.689126 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-06e1aff1-85d7-49d0-aea0-98c11e19e2f7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:16.695313 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-06e1aff1-85d7-49d0-aea0-98c11e19e2f7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:16.695762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-06e1aff1-85d7-49d0-aea0-98c11e19e2f7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:16.696536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-06e1aff1-85d7-49d0-aea0-98c11e19e2f7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:16.697415 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-06e1aff1-85d7-49d0-aea0-98c11e19e2f7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:16.748694 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5cf4c4f3-745c-4552-88a2-0bf9bbd3d63e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:16.756484 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5cf4c4f3-745c-4552-88a2-0bf9bbd3d63e tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.147814 May 12 09:41:16.757065 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 344/694] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:16 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:16.776556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-06e1aff1-85d7-49d0-aea0-98c11e19e2f7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lazy-loading 'services' on Instance uuid 3dadb998-7d24-461d-bf2f-cec5ab30fb48 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:41:16.844572 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-06e1aff1-85d7-49d0-aea0-98c11e19e2f7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/os-volume_attachments/06b2a350-9635-4791-8d41-d4765f0b49b6" status: 202 len: 0 microversion: 2.1 time: 0.159868 May 12 09:41:16.849048 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 351/695] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:41:16 2022] DELETE /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/os-volume_attachments/06b2a350-9635-4791-8d41-d4765f0b49b6 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 09:41:17.773546 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-63d8619c-ded9-4841-8039-665ec15d3909 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:17.774155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-63d8619c-ded9-4841-8039-665ec15d3909 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:17.780458 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63d8619c-ded9-4841-8039-665ec15d3909 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:17.780902 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63d8619c-ded9-4841-8039-665ec15d3909 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:17.781657 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63d8619c-ded9-4841-8039-665ec15d3909 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:17.782116 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63d8619c-ded9-4841-8039-665ec15d3909 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:17.911520 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-63d8619c-ded9-4841-8039-665ec15d3909 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:17.919544 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-63d8619c-ded9-4841-8039-665ec15d3909 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.149705 May 12 09:41:17.920127 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 345/696] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:17 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:17.978217 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-03ee6847-a7c7-4ab3-b83a-52ab7bc13e43 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:41:17.984411 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-03ee6847-a7c7-4ab3-b83a-52ab7bc13e43 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:17.984856 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-03ee6847-a7c7-4ab3-b83a-52ab7bc13e43 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:18.006878 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-03ee6847-a7c7-4ab3-b83a-52ab7bc13e43 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Going to try to stop instance {{(pid=123510) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 12 09:41:18.046566 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-03ee6847-a7c7-4ab3-b83a-52ab7bc13e43 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action" status: 202 len: 0 microversion: 2.1 time: 0.072875 May 12 09:41:18.047152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 352/697] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:41:17 2022] POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:41:18.055727 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5bbb7352-d60e-4b85-8981-97148b6f6862 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:18.056333 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5bbb7352-d60e-4b85-8981-97148b6f6862 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:18.062960 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5bbb7352-d60e-4b85-8981-97148b6f6862 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:18.064709 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5bbb7352-d60e-4b85-8981-97148b6f6862 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:18.066182 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5bbb7352-d60e-4b85-8981-97148b6f6862 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:18.067002 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5bbb7352-d60e-4b85-8981-97148b6f6862 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:18.194441 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5bbb7352-d60e-4b85-8981-97148b6f6862 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:18.201638 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5bbb7352-d60e-4b85-8981-97148b6f6862 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.149698 May 12 09:41:18.202245 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 346/698] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:18 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:18.939619 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e9153fc2-7308-48ce-b91c-63ea2bdcd998 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:18.940300 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e9153fc2-7308-48ce-b91c-63ea2bdcd998 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:18.946272 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9153fc2-7308-48ce-b91c-63ea2bdcd998 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:18.946719 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9153fc2-7308-48ce-b91c-63ea2bdcd998 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:18.947467 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9153fc2-7308-48ce-b91c-63ea2bdcd998 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:18.947898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9153fc2-7308-48ce-b91c-63ea2bdcd998 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:19.073686 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e9153fc2-7308-48ce-b91c-63ea2bdcd998 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:19.082093 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e9153fc2-7308-48ce-b91c-63ea2bdcd998 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.148584 May 12 09:41:19.082651 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 353/699] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:18 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:19.218404 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2ce19606-9847-44cc-a654-40ed06bbfc20 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:19.218924 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2ce19606-9847-44cc-a654-40ed06bbfc20 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:19.225113 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ce19606-9847-44cc-a654-40ed06bbfc20 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:19.225587 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ce19606-9847-44cc-a654-40ed06bbfc20 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:19.226382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ce19606-9847-44cc-a654-40ed06bbfc20 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:19.226819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ce19606-9847-44cc-a654-40ed06bbfc20 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:19.353683 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2ce19606-9847-44cc-a654-40ed06bbfc20 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:19.361398 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2ce19606-9847-44cc-a654-40ed06bbfc20 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.146951 May 12 09:41:19.361973 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 347/700] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:19 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:20.098654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c0c429d1-3052-4f4a-9923-b44601c85502 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:20.099244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c0c429d1-3052-4f4a-9923-b44601c85502 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:20.105606 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0c429d1-3052-4f4a-9923-b44601c85502 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:20.106111 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0c429d1-3052-4f4a-9923-b44601c85502 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:20.106867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0c429d1-3052-4f4a-9923-b44601c85502 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:20.107305 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0c429d1-3052-4f4a-9923-b44601c85502 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:20.233289 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c0c429d1-3052-4f4a-9923-b44601c85502 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:20.241007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c0c429d1-3052-4f4a-9923-b44601c85502 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.146809 May 12 09:41:20.241596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 354/701] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:20 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:20.379140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-275f9f60-3903-4d24-8b05-9943d72a1d36 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:20.379670 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-275f9f60-3903-4d24-8b05-9943d72a1d36 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:20.386188 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-275f9f60-3903-4d24-8b05-9943d72a1d36 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:20.386640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-275f9f60-3903-4d24-8b05-9943d72a1d36 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:20.387400 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-275f9f60-3903-4d24-8b05-9943d72a1d36 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:20.387835 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-275f9f60-3903-4d24-8b05-9943d72a1d36 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:20.512899 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-275f9f60-3903-4d24-8b05-9943d72a1d36 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:20.520668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-275f9f60-3903-4d24-8b05-9943d72a1d36 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.146024 May 12 09:41:20.521241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 348/702] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:20 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:21.256993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-aae45c4a-c9f5-4cd9-bc6c-a6e76acdb785 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:21.257594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-aae45c4a-c9f5-4cd9-bc6c-a6e76acdb785 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:21.264154 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-aae45c4a-c9f5-4cd9-bc6c-a6e76acdb785 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:21.264598 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-aae45c4a-c9f5-4cd9-bc6c-a6e76acdb785 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:21.265351 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-aae45c4a-c9f5-4cd9-bc6c-a6e76acdb785 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:21.265784 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-aae45c4a-c9f5-4cd9-bc6c-a6e76acdb785 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:21.392043 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-aae45c4a-c9f5-4cd9-bc6c-a6e76acdb785 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:21.399700 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-aae45c4a-c9f5-4cd9-bc6c-a6e76acdb785 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.146497 May 12 09:41:21.400264 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 355/703] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:21 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:21.538305 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0e27edeb-97d9-45f8-b1dd-229f82fba42a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:21.538854 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0e27edeb-97d9-45f8-b1dd-229f82fba42a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:21.545040 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e27edeb-97d9-45f8-b1dd-229f82fba42a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:21.545487 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e27edeb-97d9-45f8-b1dd-229f82fba42a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:21.546277 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e27edeb-97d9-45f8-b1dd-229f82fba42a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:21.546715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e27edeb-97d9-45f8-b1dd-229f82fba42a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:21.672246 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0e27edeb-97d9-45f8-b1dd-229f82fba42a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:21.679596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0e27edeb-97d9-45f8-b1dd-229f82fba42a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.145261 May 12 09:41:21.680171 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 349/704] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:21 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:22.417371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a6c2c03c-ac04-44f3-95aa-29c9238e76f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:22.417950 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a6c2c03c-ac04-44f3-95aa-29c9238e76f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:22.424676 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a6c2c03c-ac04-44f3-95aa-29c9238e76f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:22.425120 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a6c2c03c-ac04-44f3-95aa-29c9238e76f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:22.425871 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a6c2c03c-ac04-44f3-95aa-29c9238e76f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:22.426328 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a6c2c03c-ac04-44f3-95aa-29c9238e76f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:22.552027 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a6c2c03c-ac04-44f3-95aa-29c9238e76f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:22.559594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a6c2c03c-ac04-44f3-95aa-29c9238e76f0 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.146146 May 12 09:41:22.560150 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 356/705] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:22 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:22.696609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8ab61893-6afa-4644-a53b-962e5505723c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:22.697135 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8ab61893-6afa-4644-a53b-962e5505723c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:22.703375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8ab61893-6afa-4644-a53b-962e5505723c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:22.703817 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8ab61893-6afa-4644-a53b-962e5505723c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:22.704570 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8ab61893-6afa-4644-a53b-962e5505723c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:22.704997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8ab61893-6afa-4644-a53b-962e5505723c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:22.832302 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8ab61893-6afa-4644-a53b-962e5505723c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:22.839588 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8ab61893-6afa-4644-a53b-962e5505723c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.146846 May 12 09:41:22.840160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 350/706] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:22 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:23.577544 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-085277b6-256d-4f49-827f-c44b41488299 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:23.578177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-085277b6-256d-4f49-827f-c44b41488299 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:23.584481 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-085277b6-256d-4f49-827f-c44b41488299 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:23.584931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-085277b6-256d-4f49-827f-c44b41488299 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:23.585697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-085277b6-256d-4f49-827f-c44b41488299 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:23.586157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-085277b6-256d-4f49-827f-c44b41488299 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:23.712777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-085277b6-256d-4f49-827f-c44b41488299 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:23.720916 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-085277b6-256d-4f49-827f-c44b41488299 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.147232 May 12 09:41:23.721478 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 357/707] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:23 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:23.856452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c41e7359-b074-45af-b430-f31b8e80c650 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:23.856966 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c41e7359-b074-45af-b430-f31b8e80c650 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:23.863271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c41e7359-b074-45af-b430-f31b8e80c650 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:23.863715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c41e7359-b074-45af-b430-f31b8e80c650 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:23.864467 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c41e7359-b074-45af-b430-f31b8e80c650 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:23.864896 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c41e7359-b074-45af-b430-f31b8e80c650 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:23.987689 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c41e7359-b074-45af-b430-f31b8e80c650 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:23.994883 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c41e7359-b074-45af-b430-f31b8e80c650 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.142334 May 12 09:41:23.995452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 351/708] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:23 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:24.738696 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3585d019-bc8a-44df-8f5c-afd82df176ff tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:24.739250 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3585d019-bc8a-44df-8f5c-afd82df176ff tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:24.745824 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3585d019-bc8a-44df-8f5c-afd82df176ff tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:24.746312 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3585d019-bc8a-44df-8f5c-afd82df176ff tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:24.747074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3585d019-bc8a-44df-8f5c-afd82df176ff tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:24.747512 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3585d019-bc8a-44df-8f5c-afd82df176ff tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:24.871538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3585d019-bc8a-44df-8f5c-afd82df176ff tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:24.879833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3585d019-bc8a-44df-8f5c-afd82df176ff tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.145114 May 12 09:41:24.880392 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 358/709] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:24 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:25.012344 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c7c77d16-7eaa-46ba-bc48-1eaf0756f63a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:25.012891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c7c77d16-7eaa-46ba-bc48-1eaf0756f63a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:25.019791 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c7c77d16-7eaa-46ba-bc48-1eaf0756f63a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:25.020240 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c7c77d16-7eaa-46ba-bc48-1eaf0756f63a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:25.020999 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c7c77d16-7eaa-46ba-bc48-1eaf0756f63a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:25.021437 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c7c77d16-7eaa-46ba-bc48-1eaf0756f63a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:25.151514 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c7c77d16-7eaa-46ba-bc48-1eaf0756f63a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:25.158764 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c7c77d16-7eaa-46ba-bc48-1eaf0756f63a tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.150611 May 12 09:41:25.159418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 352/710] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:25 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:41:25.896447 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f5d616a5-f407-4211-aa28-736984451f0b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:25.897056 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f5d616a5-f407-4211-aa28-736984451f0b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:25.903397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f5d616a5-f407-4211-aa28-736984451f0b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:25.903842 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f5d616a5-f407-4211-aa28-736984451f0b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:25.904592 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f5d616a5-f407-4211-aa28-736984451f0b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:25.905021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f5d616a5-f407-4211-aa28-736984451f0b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:26.035206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f5d616a5-f407-4211-aa28-736984451f0b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:26.042990 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f5d616a5-f407-4211-aa28-736984451f0b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1735 microversion: 2.1 time: 0.150407 May 12 09:41:26.043552 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 359/711] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:25 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:26.176561 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a84eaa9e-c1af-4a82-81d4-d7642add4a8c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:26.177105 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a84eaa9e-c1af-4a82-81d4-d7642add4a8c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:26.183374 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a84eaa9e-c1af-4a82-81d4-d7642add4a8c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:26.183829 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a84eaa9e-c1af-4a82-81d4-d7642add4a8c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:26.184600 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a84eaa9e-c1af-4a82-81d4-d7642add4a8c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:26.185041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a84eaa9e-c1af-4a82-81d4-d7642add4a8c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:26.308027 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a84eaa9e-c1af-4a82-81d4-d7642add4a8c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:26.315754 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a84eaa9e-c1af-4a82-81d4-d7642add4a8c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.143609 May 12 09:41:26.316321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 353/712] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:26 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:27.059541 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-52e3baca-7004-467c-9852-ee76b89f6d1b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:27.060171 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-52e3baca-7004-467c-9852-ee76b89f6d1b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:27.067014 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-52e3baca-7004-467c-9852-ee76b89f6d1b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.067463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-52e3baca-7004-467c-9852-ee76b89f6d1b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.068225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-52e3baca-7004-467c-9852-ee76b89f6d1b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.068662 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-52e3baca-7004-467c-9852-ee76b89f6d1b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.198216 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-52e3baca-7004-467c-9852-ee76b89f6d1b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:27.205889 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-52e3baca-7004-467c-9852-ee76b89f6d1b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1715 microversion: 2.1 time: 0.150212 May 12 09:41:27.206474 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 360/713] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:27 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:27.259127 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:27.259627 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:27.265764 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.266251 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.267031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.267458 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.332280 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6d83e087-4d7d-4800-bcdd-ff1c0a7b45c4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:27.332916 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6d83e087-4d7d-4800-bcdd-ff1c0a7b45c4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:27.338881 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6d83e087-4d7d-4800-bcdd-ff1c0a7b45c4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.339325 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6d83e087-4d7d-4800-bcdd-ff1c0a7b45c4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.340084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6d83e087-4d7d-4800-bcdd-ff1c0a7b45c4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.340510 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6d83e087-4d7d-4800-bcdd-ff1c0a7b45c4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.343529 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] HTTP exception thrown: Cannot 'detach_volume' instance 7801a053-99b6-4a9b-9962-1620c14aac30 while it is in vm_state rescued May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Request method failure captured: May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: DELETE /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments/3c5a5735-ebd5-4659-8e32-ee1dcad04354 HTTP/1.1 May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNSHHvU-xPgJBPK25GvnemOotOHXGR0HdgQPjtw_xG3Fwc7xiEp59twyMvS4dmFXXond1D1lBsIZB4epBrlw8xntQZNkPOZPFXm1geBWQmpvwFvIdNdGKHmQ25SDCzgUNge48cZXntjNIfKPx_yscMzVLp4b9yU0ICymRlftgT-dJlo May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:41:27.346522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c54669eadc784d4aac5d1a40d18858b1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}] May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 0b01be56426e4ff1a09577f30fb79f0b May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:41:27.348010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Cannot 'detach_volume' instance 7801a053-99b6-4a9b-9962-1620c14aac30 while it is in vm_state rescued May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'server_id': '7801a053-99b6-4a9b-9962-1620c14aac30', 'id': '3c5a5735-ebd5-4659-8e32-ee1dcad04354'} May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7801a053-99b6-4a9b-9962-1620c14aac30 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:41:27.348716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7801a053-99b6-4a9b-9962-1620c14aac30 while it is in vm_state rescued May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7801a053-99b6-4a9b-9962-1620c14aac30 while it is in vm_state rescued May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:41:27.350866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Returning 409 to user: Cannot 'detach_volume' instance 7801a053-99b6-4a9b-9962-1620c14aac30 while it is in vm_state rescued {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:41:27.352473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2d56b144-7499-4d81-9493-178b156f3214 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments/3c5a5735-ebd5-4659-8e32-ee1dcad04354" status: 409 len: 152 microversion: 2.1 time: 0.093173 May 12 09:41:27.352473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 354/714] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:41:27 2022] DELETE /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments/3c5a5735-ebd5-4659-8e32-ee1dcad04354 => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 09:41:27.356949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3030feab-b53a-446a-af18-826f532acbc6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:41:27.357477 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3030feab-b53a-446a-af18-826f532acbc6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:27.364417 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3030feab-b53a-446a-af18-826f532acbc6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.364872 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3030feab-b53a-446a-af18-826f532acbc6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.365646 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3030feab-b53a-446a-af18-826f532acbc6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.366140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3030feab-b53a-446a-af18-826f532acbc6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.436653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3030feab-b53a-446a-af18-826f532acbc6 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "POST /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/action" status: 202 len: 0 microversion: 2.1 time: 0.083365 May 12 09:41:27.440209 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 355/715] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:41:27 2022] POST /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 09:41:27.445739 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f5f6af5c-15dc-4f4e-a92d-2f40f9b4af2f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:27.446593 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f5f6af5c-15dc-4f4e-a92d-2f40f9b4af2f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:27.452848 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f5f6af5c-15dc-4f4e-a92d-2f40f9b4af2f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.453264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f5f6af5c-15dc-4f4e-a92d-2f40f9b4af2f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.454167 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f5f6af5c-15dc-4f4e-a92d-2f40f9b4af2f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:27.455075 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f5f6af5c-15dc-4f4e-a92d-2f40f9b4af2f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:27.474161 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6d83e087-4d7d-4800-bcdd-ff1c0a7b45c4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:27.481825 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6d83e087-4d7d-4800-bcdd-ff1c0a7b45c4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.153280 May 12 09:41:27.482719 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 361/716] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:27 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:41:27.640282 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f5f6af5c-15dc-4f4e-a92d-2f40f9b4af2f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:27.648903 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f5f6af5c-15dc-4f4e-a92d-2f40f9b4af2f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1723 microversion: 2.1 time: 0.207021 May 12 09:41:27.659547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 356/717] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:27 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:41:28.498791 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-69f06a5c-a594-465e-a9d8-5e03bf2bf8be tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:28.499385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-69f06a5c-a594-465e-a9d8-5e03bf2bf8be tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:28.505812 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69f06a5c-a594-465e-a9d8-5e03bf2bf8be tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:28.506290 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69f06a5c-a594-465e-a9d8-5e03bf2bf8be tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:28.507053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69f06a5c-a594-465e-a9d8-5e03bf2bf8be tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:28.507490 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69f06a5c-a594-465e-a9d8-5e03bf2bf8be tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:28.636341 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-69f06a5c-a594-465e-a9d8-5e03bf2bf8be tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:28.643709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-69f06a5c-a594-465e-a9d8-5e03bf2bf8be tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.148853 May 12 09:41:28.644279 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 362/718] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:28 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:28.667186 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3f8443be-5cf3-47b1-bee2-379a718db27d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:28.667812 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3f8443be-5cf3-47b1-bee2-379a718db27d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:28.674914 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3f8443be-5cf3-47b1-bee2-379a718db27d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:28.675364 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3f8443be-5cf3-47b1-bee2-379a718db27d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:28.676113 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3f8443be-5cf3-47b1-bee2-379a718db27d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:28.676544 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3f8443be-5cf3-47b1-bee2-379a718db27d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:28.802375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-3f8443be-5cf3-47b1-bee2-379a718db27d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:28.809948 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3f8443be-5cf3-47b1-bee2-379a718db27d tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1723 microversion: 2.1 time: 0.146680 May 12 09:41:28.810506 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 357/719] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:28 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:41:29.660765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cd98a80f-4071-4d12-8840-ac7bd3e75fb4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:29.661398 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cd98a80f-4071-4d12-8840-ac7bd3e75fb4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:29.667656 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd98a80f-4071-4d12-8840-ac7bd3e75fb4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:29.668098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd98a80f-4071-4d12-8840-ac7bd3e75fb4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:29.668848 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd98a80f-4071-4d12-8840-ac7bd3e75fb4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:29.669278 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd98a80f-4071-4d12-8840-ac7bd3e75fb4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:29.796379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-cd98a80f-4071-4d12-8840-ac7bd3e75fb4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:29.804098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cd98a80f-4071-4d12-8840-ac7bd3e75fb4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1678 microversion: 2.1 time: 0.147176 May 12 09:41:29.804653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 363/720] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:29 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:29.827521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4e6db751-e4c9-4100-9ab3-ece1ff5efe7a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:29.828116 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4e6db751-e4c9-4100-9ab3-ece1ff5efe7a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:29.834298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e6db751-e4c9-4100-9ab3-ece1ff5efe7a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:29.834753 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e6db751-e4c9-4100-9ab3-ece1ff5efe7a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:29.835503 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e6db751-e4c9-4100-9ab3-ece1ff5efe7a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:29.835935 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e6db751-e4c9-4100-9ab3-ece1ff5efe7a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:29.960788 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4e6db751-e4c9-4100-9ab3-ece1ff5efe7a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:29.968293 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4e6db751-e4c9-4100-9ab3-ece1ff5efe7a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1723 microversion: 2.1 time: 0.144604 May 12 09:41:29.968854 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 358/721] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:29 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:30.821788 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-95d86800-5eea-4a27-a396-eaf0e8330656 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:30.822403 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-95d86800-5eea-4a27-a396-eaf0e8330656 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:30.828649 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-95d86800-5eea-4a27-a396-eaf0e8330656 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:30.829584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-95d86800-5eea-4a27-a396-eaf0e8330656 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:30.830375 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-95d86800-5eea-4a27-a396-eaf0e8330656 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:30.830807 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-95d86800-5eea-4a27-a396-eaf0e8330656 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:30.955472 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-95d86800-5eea-4a27-a396-eaf0e8330656 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:30.962790 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-95d86800-5eea-4a27-a396-eaf0e8330656 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1655 microversion: 2.1 time: 0.144872 May 12 09:41:30.963350 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 364/722] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:30 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1655 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:30.979308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6a2532fb-7058-41d8-be73-821efd33d289 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:41:30.987181 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-55bcc264-d0ef-425d-98c4-5519eb5e8b51 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:30.987925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-55bcc264-d0ef-425d-98c4-5519eb5e8b51 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:30.989000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6a2532fb-7058-41d8-be73-821efd33d289 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:30.989457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6a2532fb-7058-41d8-be73-821efd33d289 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:30.993768 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-55bcc264-d0ef-425d-98c4-5519eb5e8b51 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:30.994246 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-55bcc264-d0ef-425d-98c4-5519eb5e8b51 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:30.995026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-55bcc264-d0ef-425d-98c4-5519eb5e8b51 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:30.995466 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-55bcc264-d0ef-425d-98c4-5519eb5e8b51 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:31.014401 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6a2532fb-7058-41d8-be73-821efd33d289 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Going to try to start instance {{(pid=123509) start /opt/stack/nova/nova/compute/api.py:2730}} May 12 09:41:31.060641 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6a2532fb-7058-41d8-be73-821efd33d289 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action" status: 202 len: 0 microversion: 2.1 time: 0.085020 May 12 09:41:31.061265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 359/723] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:41:30 2022] POST /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:41:31.070328 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ed6ebd49-0591-4ce0-a8ea-3aa56bb43b5b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:31.071020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ed6ebd49-0591-4ce0-a8ea-3aa56bb43b5b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:31.077102 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ed6ebd49-0591-4ce0-a8ea-3aa56bb43b5b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:31.077474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ed6ebd49-0591-4ce0-a8ea-3aa56bb43b5b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:31.078316 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ed6ebd49-0591-4ce0-a8ea-3aa56bb43b5b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:31.078744 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ed6ebd49-0591-4ce0-a8ea-3aa56bb43b5b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:31.165155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-55bcc264-d0ef-425d-98c4-5519eb5e8b51 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:31.175617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-55bcc264-d0ef-425d-98c4-5519eb5e8b51 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1723 microversion: 2.1 time: 0.192226 May 12 09:41:31.177946 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 365/724] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:30 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:41:31.230622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ed6ebd49-0591-4ce0-a8ea-3aa56bb43b5b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:31.238806 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ed6ebd49-0591-4ce0-a8ea-3aa56bb43b5b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1664 microversion: 2.1 time: 0.172627 May 12 09:41:31.239365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 360/725] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:31 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:41:32.192463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7be72caf-f9f8-4571-9742-3bb4de187d6a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:32.193099 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7be72caf-f9f8-4571-9742-3bb4de187d6a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:32.199603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7be72caf-f9f8-4571-9742-3bb4de187d6a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:32.200082 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7be72caf-f9f8-4571-9742-3bb4de187d6a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:32.200852 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7be72caf-f9f8-4571-9742-3bb4de187d6a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:32.201318 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7be72caf-f9f8-4571-9742-3bb4de187d6a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:32.256484 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6a7b1f6e-2d9e-4f23-96d7-52fa46db1c69 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:32.257117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6a7b1f6e-2d9e-4f23-96d7-52fa46db1c69 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:32.263719 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6a7b1f6e-2d9e-4f23-96d7-52fa46db1c69 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:32.264169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6a7b1f6e-2d9e-4f23-96d7-52fa46db1c69 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:32.264937 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6a7b1f6e-2d9e-4f23-96d7-52fa46db1c69 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:32.265366 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6a7b1f6e-2d9e-4f23-96d7-52fa46db1c69 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:32.363382 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7be72caf-f9f8-4571-9742-3bb4de187d6a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:32.371194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7be72caf-f9f8-4571-9742-3bb4de187d6a tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1729 microversion: 2.1 time: 0.182619 May 12 09:41:32.371768 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 366/726] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:32 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:32.388532 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d3a66e33-4d2b-425d-97fc-2ea0d7752d16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:32.389018 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d3a66e33-4d2b-425d-97fc-2ea0d7752d16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:32.395623 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d3a66e33-4d2b-425d-97fc-2ea0d7752d16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:32.396068 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d3a66e33-4d2b-425d-97fc-2ea0d7752d16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:32.396825 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d3a66e33-4d2b-425d-97fc-2ea0d7752d16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:32.397258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d3a66e33-4d2b-425d-97fc-2ea0d7752d16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:32.423700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6a7b1f6e-2d9e-4f23-96d7-52fa46db1c69 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:32.430951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6a7b1f6e-2d9e-4f23-96d7-52fa46db1c69 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1664 microversion: 2.1 time: 0.178340 May 12 09:41:32.431527 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 361/727] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:32 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:41:32.471525 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d3a66e33-4d2b-425d-97fc-2ea0d7752d16 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086714 May 12 09:41:32.472115 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 367/728] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 12 09:41:32 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:41:33.448445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0aa8bd21-396a-43da-a403-6b4a6facab93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:41:33.449062 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0aa8bd21-396a-43da-a403-6b4a6facab93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:41:33.455863 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0aa8bd21-396a-43da-a403-6b4a6facab93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:33.456309 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0aa8bd21-396a-43da-a403-6b4a6facab93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:33.457080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0aa8bd21-396a-43da-a403-6b4a6facab93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:33.457516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0aa8bd21-396a-43da-a403-6b4a6facab93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:33.670141 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0aa8bd21-396a-43da-a403-6b4a6facab93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:41:33.678212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0aa8bd21-396a-43da-a403-6b4a6facab93 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1668 microversion: 2.1 time: 0.233509 May 12 09:41:33.679092 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 362/729] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:41:33 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1668 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:41:33.684449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-36f28c75-b68a-405c-a91c-76815c786baf req-b73757c3-ff83-4814-b702-4f48c900996f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7801a053-99b6-4a9b-9962-1620c14aac30", "tag": "475e0f9c-a9a4-469d-8d8e-9e0f42721e10"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:41:33.693477 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-36f28c75-b68a-405c-a91c-76815c786baf req-b73757c3-ff83-4814-b702-4f48c900996f service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:33.694138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-36f28c75-b68a-405c-a91c-76815c786baf req-b73757c3-ff83-4814-b702-4f48c900996f service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:33.707062 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-36f28c75-b68a-405c-a91c-76815c786baf req-b73757c3-ff83-4814-b702-4f48c900996f service nova] Creating event network-changed:475e0f9c-a9a4-469d-8d8e-9e0f42721e10 for instance 7801a053-99b6-4a9b-9962-1620c14aac30 on hv-cinder-83769 May 12 09:41:33.715184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-36f28c75-b68a-405c-a91c-76815c786baf req-b73757c3-ff83-4814-b702-4f48c900996f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034933 May 12 09:41:33.716157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 368/730] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:41:35.729485 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-f7599920-e1fb-48bb-be77-572f67b6b893 req-8bbc37f2-187f-4e9a-b736-0f903dd40d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7801a053-99b6-4a9b-9962-1620c14aac30", "tag": "475e0f9c-a9a4-469d-8d8e-9e0f42721e10"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:41:35.738332 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-f7599920-e1fb-48bb-be77-572f67b6b893 req-8bbc37f2-187f-4e9a-b736-0f903dd40d0b service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:41:35.738773 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-f7599920-e1fb-48bb-be77-572f67b6b893 req-8bbc37f2-187f-4e9a-b736-0f903dd40d0b service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:41:35.749072 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-f7599920-e1fb-48bb-be77-572f67b6b893 req-8bbc37f2-187f-4e9a-b736-0f903dd40d0b service nova] Creating event network-changed:475e0f9c-a9a4-469d-8d8e-9e0f42721e10 for instance 7801a053-99b6-4a9b-9962-1620c14aac30 on hv-cinder-83769 May 12 09:41:35.753652 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-f7599920-e1fb-48bb-be77-572f67b6b893 req-8bbc37f2-187f-4e9a-b736-0f903dd40d0b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027866 May 12 09:41:35.754250 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 363/731] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:02.802522 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d6e94709-eb87-4892-a334-d8a7422b3d87 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:02.803165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d6e94709-eb87-4892-a334-d8a7422b3d87 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:02.809127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d6e94709-eb87-4892-a334-d8a7422b3d87 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:02.809574 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d6e94709-eb87-4892-a334-d8a7422b3d87 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:02.810357 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d6e94709-eb87-4892-a334-d8a7422b3d87 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:02.810788 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d6e94709-eb87-4892-a334-d8a7422b3d87 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:02.832853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d6e94709-eb87-4892-a334-d8a7422b3d87 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc/ips" status: 200 len: 150 microversion: 2.1 time: 0.034728 May 12 09:42:02.833390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 369/732] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:42:02 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:02.845294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0937877-1982-4445-85be-ca0dcd958bbf"}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:02.846511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:02.852460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:02.852909 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:02.853669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:02.854140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:02.929632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Invalid volume: volume b0937877-1982-4445-85be-ca0dcd958bbf is already attached to instances: dc90e8c3-13f2-4b3e-91e8-396847cf6572 May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: POST /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc/os-volume_attachments HTTP/1.1 May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 74 May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:42:02.931574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {"volumeAttachment": {"volumeId": "b0937877-1982-4445-85be-ca0dcd958bbf"}} May 12 09:42:02.933278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Invalid volume: volume b0937877-1982-4445-85be-ca0dcd958bbf is already attached to instances: dc90e8c3-13f2-4b3e-91e8-396847cf6572 May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'server_id': '33ce3bd7-6835-4430-8fd7-05afeb6925fc', 'body': {'volumeAttachment': {'volumeId': 'b0937877-1982-4445-85be-ca0dcd958bbf'}}} May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b0937877-1982-4445-85be-ca0dcd958bbf is already attached to instances: dc90e8c3-13f2-4b3e-91e8-396847cf6572 May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:02.934354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b0937877-1982-4445-85be-ca0dcd958bbf is already attached to instances: dc90e8c3-13f2-4b3e-91e8-396847cf6572 May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:02.935610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:02.937560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:02.937560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:42:02.937560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:42:02.937560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b0937877-1982-4445-85be-ca0dcd958bbf is already attached to instances: dc90e8c3-13f2-4b3e-91e8-396847cf6572 May 12 09:42:02.937560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:02.937560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 400 to user: Invalid volume: volume b0937877-1982-4445-85be-ca0dcd958bbf is already attached to instances: dc90e8c3-13f2-4b3e-91e8-396847cf6572 {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:42:02.937560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-925e8214-4d45-4c49-bb96-9cce1ead03f5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093158 May 12 09:42:02.937560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 364/733] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:42:02 2022] POST /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 09:42:02.941832 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-006dd7e8-bc4d-45b0-a6cd-f89eeb6c7581 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:02.942354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-006dd7e8-bc4d-45b0-a6cd-f89eeb6c7581 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:02.948327 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-006dd7e8-bc4d-45b0-a6cd-f89eeb6c7581 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:02.949002 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-006dd7e8-bc4d-45b0-a6cd-f89eeb6c7581 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:02.949753 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-006dd7e8-bc4d-45b0-a6cd-f89eeb6c7581 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:02.950212 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-006dd7e8-bc4d-45b0-a6cd-f89eeb6c7581 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:02.974551 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-006dd7e8-bc4d-45b0-a6cd-f89eeb6c7581 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:42:03.045336 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-006dd7e8-bc4d-45b0-a6cd-f89eeb6c7581 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 204 len: 0 microversion: 2.1 time: 0.106990 May 12 09:42:03.045927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 370/734] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:42:02 2022] DELETE /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:42:03.054493 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-efd9c227-8be8-4eb6-83e9-ee8119dd7182 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:03.055078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-efd9c227-8be8-4eb6-83e9-ee8119dd7182 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:03.062458 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efd9c227-8be8-4eb6-83e9-ee8119dd7182 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:03.062899 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efd9c227-8be8-4eb6-83e9-ee8119dd7182 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:03.063656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efd9c227-8be8-4eb6-83e9-ee8119dd7182 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:03.064088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efd9c227-8be8-4eb6-83e9-ee8119dd7182 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:03.192547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-efd9c227-8be8-4eb6-83e9-ee8119dd7182 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:03.200168 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-efd9c227-8be8-4eb6-83e9-ee8119dd7182 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1681 microversion: 2.1 time: 0.149891 May 12 09:42:03.200732 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 365/735] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:03 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:42:04.220130 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5373304a-6e5a-406f-b9a5-32b773e83d61 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:04.220864 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5373304a-6e5a-406f-b9a5-32b773e83d61 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:04.227293 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5373304a-6e5a-406f-b9a5-32b773e83d61 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:04.227747 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5373304a-6e5a-406f-b9a5-32b773e83d61 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:04.228513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5373304a-6e5a-406f-b9a5-32b773e83d61 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:04.228953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5373304a-6e5a-406f-b9a5-32b773e83d61 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:04.358322 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5373304a-6e5a-406f-b9a5-32b773e83d61 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:04.365565 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5373304a-6e5a-406f-b9a5-32b773e83d61 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1681 microversion: 2.1 time: 0.150150 May 12 09:42:04.366146 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 371/736] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:04 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:05.382833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-eee1c630-12ad-48c1-82a6-19705d5c9b2e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:05.383695 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-eee1c630-12ad-48c1-82a6-19705d5c9b2e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:05.390173 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eee1c630-12ad-48c1-82a6-19705d5c9b2e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:05.390714 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eee1c630-12ad-48c1-82a6-19705d5c9b2e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:05.391478 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eee1c630-12ad-48c1-82a6-19705d5c9b2e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:05.391920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-eee1c630-12ad-48c1-82a6-19705d5c9b2e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:05.648860 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-eee1c630-12ad-48c1-82a6-19705d5c9b2e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:05.656519 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-eee1c630-12ad-48c1-82a6-19705d5c9b2e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1681 microversion: 2.1 time: 0.277032 May 12 09:42:05.657088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 366/737] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:05 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1681 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:06.205585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-8b188559-084a-4ac2-b635-4bad39f193fb req-2235c975-1dea-4fac-970b-3564368e0a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ce3bd7-6835-4430-8fd7-05afeb6925fc", "name": "network-vif-deleted", "tag": "0bff5673-9db4-4e7f-89c0-c77db087a526"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:06.214821 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-8b188559-084a-4ac2-b635-4bad39f193fb req-2235c975-1dea-4fac-970b-3564368e0a5e service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:06.215379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-8b188559-084a-4ac2-b635-4bad39f193fb req-2235c975-1dea-4fac-970b-3564368e0a5e service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:06.226509 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-8b188559-084a-4ac2-b635-4bad39f193fb req-2235c975-1dea-4fac-970b-3564368e0a5e service nova] Creating event network-vif-deleted:0bff5673-9db4-4e7f-89c0-c77db087a526 for instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc on hv-cinder-83769 May 12 09:42:06.231760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-8b188559-084a-4ac2-b635-4bad39f193fb req-2235c975-1dea-4fac-970b-3564368e0a5e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029948 May 12 09:42:06.232387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 372/738] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:06.674315 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:06.674948 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:06.681476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:06.681967 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:06.683010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:06.683500 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:06.715754 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:06.716197 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:06.716657 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lazy-loading 'fault' on Instance uuid 33ce3bd7-6835-4430-8fd7-05afeb6925fc {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:42:06.760512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:06.768036 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7d32b9cf-a365-4961-ae28-e1e76efe5374 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 200 len: 1331 microversion: 2.1 time: 0.098217 May 12 09:42:06.768629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 367/739] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:06 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:07.785576 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:07.786314 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:07.792416 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:07.792866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:07.793631 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:07.794121 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:07.806972 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc HTTP/1.1 May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:42:07.808535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:42:07.810155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '33ce3bd7-6835-4430-8fd7-05afeb6925fc'} May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:42:07.811058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:42:07.812996 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:07.814442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:42:07.814442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ce4f105a-0c5e-4ef0-8032-4de13083c009 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 404 len: 111 microversion: 2.1 time: 0.029018 May 12 09:42:07.814442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 373/740] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:07 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:42:07.819201 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-011e35a7-ba7f-4eee-9af2-1e6d3807c2ec tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '.version_select at 0x7f872605a430>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:07.841025 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-011e35a7-ba7f-4eee-9af2-1e6d3807c2ec tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133437425" status: 202 len: 0 microversion: 2.1 time: 0.025674 May 12 09:42:07.841581 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 368/741] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 12 09:42:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133437425 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:42:08.477714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6416c3d3-e150-479e-a7bd-7f1a3ba25c78 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:08.478218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6416c3d3-e150-479e-a7bd-7f1a3ba25c78 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:08.484578 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6416c3d3-e150-479e-a7bd-7f1a3ba25c78 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:08.485025 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6416c3d3-e150-479e-a7bd-7f1a3ba25c78 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:08.485781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6416c3d3-e150-479e-a7bd-7f1a3ba25c78 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:08.486250 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6416c3d3-e150-479e-a7bd-7f1a3ba25c78 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:08.562944 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-6416c3d3-e150-479e-a7bd-7f1a3ba25c78 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lazy-loading 'services' on Instance uuid dc90e8c3-13f2-4b3e-91e8-396847cf6572 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:42:08.633349 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6416c3d3-e150-479e-a7bd-7f1a3ba25c78 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments/b0937877-1982-4445-85be-ca0dcd958bbf" status: 202 len: 0 microversion: 2.1 time: 0.159051 May 12 09:42:08.633947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 374/742] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:42:08 2022] DELETE /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments/b0937877-1982-4445-85be-ca0dcd958bbf => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:42:08.642912 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-48871613-4858-4abd-9558-17bcf74dbff0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:08.643904 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-48871613-4858-4abd-9558-17bcf74dbff0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:08.650562 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-48871613-4858-4abd-9558-17bcf74dbff0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:08.651007 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-48871613-4858-4abd-9558-17bcf74dbff0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:08.651879 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-48871613-4858-4abd-9558-17bcf74dbff0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:08.652347 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-48871613-4858-4abd-9558-17bcf74dbff0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:08.683784 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-48871613-4858-4abd-9558-17bcf74dbff0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 May 12 09:42:08.684359 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 369/743] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:42:08 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:09.700127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2224c103-4a3a-4ef0-9b92-3253c7671fb8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:09.701755 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2224c103-4a3a-4ef0-9b92-3253c7671fb8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:09.711258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2224c103-4a3a-4ef0-9b92-3253c7671fb8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:09.711987 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2224c103-4a3a-4ef0-9b92-3253c7671fb8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:09.713254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2224c103-4a3a-4ef0-9b92-3253c7671fb8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:09.714015 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2224c103-4a3a-4ef0-9b92-3253c7671fb8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:09.746212 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2224c103-4a3a-4ef0-9b92-3253c7671fb8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054215 May 12 09:42:09.746754 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 375/744] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:42:09 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:10.758683 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-73f5aee5-6b73-43a4-ad05-3480881fc82a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:10.759629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-73f5aee5-6b73-43a4-ad05-3480881fc82a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:10.766591 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-73f5aee5-6b73-43a4-ad05-3480881fc82a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:10.767032 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-73f5aee5-6b73-43a4-ad05-3480881fc82a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:10.767784 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-73f5aee5-6b73-43a4-ad05-3480881fc82a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:10.768212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-73f5aee5-6b73-43a4-ad05-3480881fc82a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:10.794862 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-73f5aee5-6b73-43a4-ad05-3480881fc82a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040429 May 12 09:42:10.795592 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 370/745] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:42:10 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 09:42:10.850621 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9733a86d-0b03-4916-b23b-980a3b59f123 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:10.851152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9733a86d-0b03-4916-b23b-980a3b59f123 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:10.857322 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9733a86d-0b03-4916-b23b-980a3b59f123 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:10.857765 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9733a86d-0b03-4916-b23b-980a3b59f123 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:10.858555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9733a86d-0b03-4916-b23b-980a3b59f123 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:10.858986 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9733a86d-0b03-4916-b23b-980a3b59f123 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:10.888188 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9733a86d-0b03-4916-b23b-980a3b59f123 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:42:10.960352 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9733a86d-0b03-4916-b23b-980a3b59f123 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 204 len: 0 microversion: 2.1 time: 0.113164 May 12 09:42:10.961066 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 376/746] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:42:10 2022] DELETE /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:42:10.970388 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2995a13a-b3c3-4398-bc06-eebc7726dc65 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:10.971017 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2995a13a-b3c3-4398-bc06-eebc7726dc65 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:10.976719 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2995a13a-b3c3-4398-bc06-eebc7726dc65 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:10.977167 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2995a13a-b3c3-4398-bc06-eebc7726dc65 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:10.978049 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2995a13a-b3c3-4398-bc06-eebc7726dc65 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:10.978482 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2995a13a-b3c3-4398-bc06-eebc7726dc65 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:11.102886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2995a13a-b3c3-4398-bc06-eebc7726dc65 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:11.110637 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2995a13a-b3c3-4398-bc06-eebc7726dc65 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1683 microversion: 2.1 time: 0.144594 May 12 09:42:11.111202 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 371/747] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:10 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:12.137170 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9f51e0d9-a228-4155-9daa-f6ff5c3283c5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:12.137864 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9f51e0d9-a228-4155-9daa-f6ff5c3283c5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:12.144812 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9f51e0d9-a228-4155-9daa-f6ff5c3283c5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:12.145255 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9f51e0d9-a228-4155-9daa-f6ff5c3283c5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:12.146033 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9f51e0d9-a228-4155-9daa-f6ff5c3283c5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:12.146464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9f51e0d9-a228-4155-9daa-f6ff5c3283c5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:12.272004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9f51e0d9-a228-4155-9daa-f6ff5c3283c5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:12.279235 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9f51e0d9-a228-4155-9daa-f6ff5c3283c5 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1683 microversion: 2.1 time: 0.155180 May 12 09:42:12.279800 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 377/748] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:12 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:13.128211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-409a728e-967e-4e9f-a96c-a1f5da4c6a52 req-0465cf56-edc4-4a9e-96dc-85c2b8131175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc90e8c3-13f2-4b3e-91e8-396847cf6572", "name": "network-vif-deleted", "tag": "332c08c8-a0fb-4e00-b6b4-9b038555668c"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:13.137476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-409a728e-967e-4e9f-a96c-a1f5da4c6a52 req-0465cf56-edc4-4a9e-96dc-85c2b8131175 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:13.137946 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-409a728e-967e-4e9f-a96c-a1f5da4c6a52 req-0465cf56-edc4-4a9e-96dc-85c2b8131175 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:13.148512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-409a728e-967e-4e9f-a96c-a1f5da4c6a52 req-0465cf56-edc4-4a9e-96dc-85c2b8131175 service nova] Creating event network-vif-deleted:332c08c8-a0fb-4e00-b6b4-9b038555668c for instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 on hv-cinder-83769 May 12 09:42:13.153346 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-409a728e-967e-4e9f-a96c-a1f5da4c6a52 req-0465cf56-edc4-4a9e-96dc-85c2b8131175 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028920 May 12 09:42:13.153958 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 372/749] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:13.296497 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:13.297144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:13.304301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:13.304754 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:13.305726 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:13.306427 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:13.340626 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:13.341078 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:13.341536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lazy-loading 'fault' on Instance uuid dc90e8c3-13f2-4b3e-91e8-396847cf6572 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:42:13.384939 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:13.392689 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9b3425dd-bce5-4392-a0fa-da829137082e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 200 len: 1332 microversion: 2.1 time: 0.100069 May 12 09:42:13.393248 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 378/750] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:13 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:14.411248 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:14.411865 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:14.418137 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:14.418594 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:14.419362 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:14.419820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:14.433291 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 HTTP/1.1 May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:42:14.434908 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:42:14.436490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'dc90e8c3-13f2-4b3e-91e8-396847cf6572'} May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:42:14.437431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:42:14.438888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:14.440406 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:42:14.440406 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ace497b7-fa22-4be2-ba6a-5c4faf91bfa1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 404 len: 111 microversion: 2.1 time: 0.029847 May 12 09:42:14.440406 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 373/751] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:14 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:42:14.445032 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6d5f34e9-7c55-4e9c-8a36-dddb47f6c3b6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '.version_select at 0x7f872563c0d0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:14.469914 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6d5f34e9-7c55-4e9c-8a36-dddb47f6c3b6 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031176220" status: 202 len: 0 microversion: 2.1 time: 0.028587 May 12 09:42:14.470500 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 379/752] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 12 09:42:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031176220 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:42:15.339072 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3b09fb5c-bc88-403b-999b-1fddcd7981a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: .version_select at 0x7f8725fe3d30>, body: {"keypair": {"name": "tempest-keypair-1209451788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtYPQIN9CasRxZ/Hdrk0dZGEELmCniXPVW1GWISpHcqpgfJOykF/Ujpqy5gkOh/kQ0/Bl9HmKq90Y/1RSS463YenaZ7Tf/luI533sMiUIOoLSg0lP5dTDwgTt70te+EBg=="}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:15.352191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-3b09fb5c-bc88-403b-999b-1fddcd7981a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:42:15.355775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-3b09fb5c-bc88-403b-999b-1fddcd7981a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for user 6c8297034cfa40438000e7d94419a429 and project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:42:15.376281 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3b09fb5c-bc88-403b-999b-1fddcd7981a8 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.041200 May 12 09:42:15.376852 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 374/753] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:42:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:16.605570 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1726902203", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8bd03ea-0f3b-46bf-82a8-531c929bec57"}], "security_groups": [{"name": "tempest-securitygroup--795143519"}], "key_name": "tempest-keypair-1209451788", "user_data": "}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:16.701487 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] validate_networks() for [('d8bd03ea-0f3b-46bf-82a8-531c929bec57', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:42:17.058503 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:42:17.058985 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:42:17.059456 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:42:17.059860 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:42:17.060268 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:42:17.069331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:17.069773 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:17.070597 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:17.071034 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:17.087296 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:42:17.091066 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for user 6c8297034cfa40438000e7d94419a429 and project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:42:17.101879 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:42:17.104149 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:42:17.150714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-34aaf882-8b59-4824-abbd-8bf99e6b050f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.549901 May 12 09:42:17.151626 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 380/754] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:42:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:42:17.161868 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f0196c2c-5672-4f2c-9c64-bbae82275b45 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:17.162500 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f0196c2c-5672-4f2c-9c64-bbae82275b45 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:17.224778 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f0196c2c-5672-4f2c-9c64-bbae82275b45 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:17.232833 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f0196c2c-5672-4f2c-9c64-bbae82275b45 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1242 microversion: 2.1 time: 0.075353 May 12 09:42:17.233408 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 375/755] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:17 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:18.250280 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-47d8e6ab-8511-41fd-ac8e-135f26c35a53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:18.250888 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-47d8e6ab-8511-41fd-ac8e-135f26c35a53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:18.256870 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-47d8e6ab-8511-41fd-ac8e-135f26c35a53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:18.257323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-47d8e6ab-8511-41fd-ac8e-135f26c35a53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:18.258381 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-47d8e6ab-8511-41fd-ac8e-135f26c35a53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:18.258820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-47d8e6ab-8511-41fd-ac8e-135f26c35a53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:18.320306 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-47d8e6ab-8511-41fd-ac8e-135f26c35a53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:18.327824 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-47d8e6ab-8511-41fd-ac8e-135f26c35a53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1294 microversion: 2.1 time: 0.081936 May 12 09:42:18.328379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 381/756] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:18 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:19.344760 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5c6d1101-8682-4b82-b6aa-c3b870828306 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:19.345430 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5c6d1101-8682-4b82-b6aa-c3b870828306 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:19.352585 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5c6d1101-8682-4b82-b6aa-c3b870828306 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:19.353042 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5c6d1101-8682-4b82-b6aa-c3b870828306 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:19.353873 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5c6d1101-8682-4b82-b6aa-c3b870828306 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:19.354349 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5c6d1101-8682-4b82-b6aa-c3b870828306 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:19.560156 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5c6d1101-8682-4b82-b6aa-c3b870828306 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:19.567827 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5c6d1101-8682-4b82-b6aa-c3b870828306 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1367 microversion: 2.1 time: 0.227119 May 12 09:42:19.568483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 376/757] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:19 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:19.914465 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-d648ff5a-6b9f-4b55-807e-988d338961d6 req-7188e83b-dbce-494c-a23a-a6c3d0f32704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d69574-dc82-4b58-a777-9618741b0e9c", "tag": "ec3b1faa-64e6-47cb-8540-2a02a8bf548c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:19.931593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-d648ff5a-6b9f-4b55-807e-988d338961d6 req-7188e83b-dbce-494c-a23a-a6c3d0f32704 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:19.932040 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-d648ff5a-6b9f-4b55-807e-988d338961d6 req-7188e83b-dbce-494c-a23a-a6c3d0f32704 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:19.944187 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-d648ff5a-6b9f-4b55-807e-988d338961d6 req-7188e83b-dbce-494c-a23a-a6c3d0f32704 service nova] Creating event network-changed:ec3b1faa-64e6-47cb-8540-2a02a8bf548c for instance c8d69574-dc82-4b58-a777-9618741b0e9c on hv-cinder-83769 May 12 09:42:19.949287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-d648ff5a-6b9f-4b55-807e-988d338961d6 req-7188e83b-dbce-494c-a23a-a6c3d0f32704 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038382 May 12 09:42:19.950419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 382/758] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:20.584912 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e45f9804-a24b-46a5-b5af-8bd0e39eaf67 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:20.585549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e45f9804-a24b-46a5-b5af-8bd0e39eaf67 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:20.591826 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e45f9804-a24b-46a5-b5af-8bd0e39eaf67 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:20.592275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e45f9804-a24b-46a5-b5af-8bd0e39eaf67 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:20.593038 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e45f9804-a24b-46a5-b5af-8bd0e39eaf67 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:20.593474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e45f9804-a24b-46a5-b5af-8bd0e39eaf67 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:20.719708 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e45f9804-a24b-46a5-b5af-8bd0e39eaf67 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:20.726876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e45f9804-a24b-46a5-b5af-8bd0e39eaf67 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1367 microversion: 2.1 time: 0.145923 May 12 09:42:20.727461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 377/759] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:20 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:21.747210 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6db2eff0-3a4b-4b97-bc12-9704726e5a28 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:21.747971 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6db2eff0-3a4b-4b97-bc12-9704726e5a28 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:21.754377 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6db2eff0-3a4b-4b97-bc12-9704726e5a28 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:21.754820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6db2eff0-3a4b-4b97-bc12-9704726e5a28 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:21.755577 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6db2eff0-3a4b-4b97-bc12-9704726e5a28 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:21.756011 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6db2eff0-3a4b-4b97-bc12-9704726e5a28 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:21.884940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6db2eff0-3a4b-4b97-bc12-9704726e5a28 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:21.892698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6db2eff0-3a4b-4b97-bc12-9704726e5a28 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1367 microversion: 2.1 time: 0.150718 May 12 09:42:21.893245 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 383/760] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:21 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:22.909690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d0a10a71-ed2f-4f54-aa1c-09b3fae122a1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:22.910324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d0a10a71-ed2f-4f54-aa1c-09b3fae122a1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:22.916590 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0a10a71-ed2f-4f54-aa1c-09b3fae122a1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:22.917039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0a10a71-ed2f-4f54-aa1c-09b3fae122a1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:22.917797 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0a10a71-ed2f-4f54-aa1c-09b3fae122a1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:22.918256 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0a10a71-ed2f-4f54-aa1c-09b3fae122a1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:23.043875 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d0a10a71-ed2f-4f54-aa1c-09b3fae122a1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:23.051020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d0a10a71-ed2f-4f54-aa1c-09b3fae122a1 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1367 microversion: 2.1 time: 0.145638 May 12 09:42:23.051576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 378/761] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:22 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:24.068505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3f9e5cf6-dd82-4948-b5f1-0143ad6b9951 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:24.069100 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3f9e5cf6-dd82-4948-b5f1-0143ad6b9951 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:24.075335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3f9e5cf6-dd82-4948-b5f1-0143ad6b9951 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:24.075812 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3f9e5cf6-dd82-4948-b5f1-0143ad6b9951 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:24.076553 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3f9e5cf6-dd82-4948-b5f1-0143ad6b9951 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:24.076982 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3f9e5cf6-dd82-4948-b5f1-0143ad6b9951 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:24.199800 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3f9e5cf6-dd82-4948-b5f1-0143ad6b9951 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:24.206962 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3f9e5cf6-dd82-4948-b5f1-0143ad6b9951 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1367 microversion: 2.1 time: 0.142456 May 12 09:42:24.207506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 384/762] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:24 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:25.223687 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e07b518f-857b-4809-8207-df71871b15af tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:25.224294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e07b518f-857b-4809-8207-df71871b15af tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:25.230622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e07b518f-857b-4809-8207-df71871b15af tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:25.231064 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e07b518f-857b-4809-8207-df71871b15af tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:25.231822 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e07b518f-857b-4809-8207-df71871b15af tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:25.232249 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e07b518f-857b-4809-8207-df71871b15af tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:25.359597 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e07b518f-857b-4809-8207-df71871b15af tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:25.366799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e07b518f-857b-4809-8207-df71871b15af tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1367 microversion: 2.1 time: 0.147088 May 12 09:42:25.367394 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 379/763] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:25 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:25.410400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-a7a398e0-4805-4e9e-9ebf-a7b3dde66beb req-25711dca-8cc5-4b31-af51-bfce96135211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d69574-dc82-4b58-a777-9618741b0e9c", "name": "network-vif-plugged", "status": "completed", "tag": "ec3b1faa-64e6-47cb-8540-2a02a8bf548c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:25.419741 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-a7a398e0-4805-4e9e-9ebf-a7b3dde66beb req-25711dca-8cc5-4b31-af51-bfce96135211 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:25.420273 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-a7a398e0-4805-4e9e-9ebf-a7b3dde66beb req-25711dca-8cc5-4b31-af51-bfce96135211 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:25.432103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-a7a398e0-4805-4e9e-9ebf-a7b3dde66beb req-25711dca-8cc5-4b31-af51-bfce96135211 service nova] Creating event network-vif-plugged:ec3b1faa-64e6-47cb-8540-2a02a8bf548c for instance c8d69574-dc82-4b58-a777-9618741b0e9c on hv-cinder-83769 May 12 09:42:25.438118 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-a7a398e0-4805-4e9e-9ebf-a7b3dde66beb req-25711dca-8cc5-4b31-af51-bfce96135211 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030750 May 12 09:42:25.438692 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 385/764] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:26.383568 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d48692db-6062-4ac9-9775-de11cd8bb22b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:26.384123 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d48692db-6062-4ac9-9775-de11cd8bb22b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:26.390955 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d48692db-6062-4ac9-9775-de11cd8bb22b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:26.391402 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d48692db-6062-4ac9-9775-de11cd8bb22b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:26.392748 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d48692db-6062-4ac9-9775-de11cd8bb22b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:26.393181 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d48692db-6062-4ac9-9775-de11cd8bb22b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:26.519328 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d48692db-6062-4ac9-9775-de11cd8bb22b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:26.526516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d48692db-6062-4ac9-9775-de11cd8bb22b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1367 microversion: 2.1 time: 0.147140 May 12 09:42:26.527083 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 380/765] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:26 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:27.544303 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4493c077-ccbb-475b-b135-2db203b575fa tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:27.544987 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4493c077-ccbb-475b-b135-2db203b575fa tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:27.551625 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4493c077-ccbb-475b-b135-2db203b575fa tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:27.552069 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4493c077-ccbb-475b-b135-2db203b575fa tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:27.552819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4493c077-ccbb-475b-b135-2db203b575fa tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:27.553248 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4493c077-ccbb-475b-b135-2db203b575fa tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:27.684510 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4493c077-ccbb-475b-b135-2db203b575fa tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:27.691704 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4493c077-ccbb-475b-b135-2db203b575fa tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1367 microversion: 2.1 time: 0.152126 May 12 09:42:27.692263 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 386/766] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:27 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:28.708081 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-04e4370a-3938-4439-a8a6-ddeab279b38f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:28.708680 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-04e4370a-3938-4439-a8a6-ddeab279b38f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:28.714996 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-04e4370a-3938-4439-a8a6-ddeab279b38f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:28.715442 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-04e4370a-3938-4439-a8a6-ddeab279b38f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:28.716201 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-04e4370a-3938-4439-a8a6-ddeab279b38f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:28.716641 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-04e4370a-3938-4439-a8a6-ddeab279b38f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:28.840060 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-04e4370a-3938-4439-a8a6-ddeab279b38f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:28.847303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-04e4370a-3938-4439-a8a6-ddeab279b38f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1557 microversion: 2.1 time: 0.143075 May 12 09:42:28.847864 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 381/767] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:28 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1557 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:28.865416 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b0ce90e8-5d0a-4be5-85ba-83647a8fda2d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:28.865991 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b0ce90e8-5d0a-4be5-85ba-83647a8fda2d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:28.872266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b0ce90e8-5d0a-4be5-85ba-83647a8fda2d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:28.872715 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b0ce90e8-5d0a-4be5-85ba-83647a8fda2d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:28.873479 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b0ce90e8-5d0a-4be5-85ba-83647a8fda2d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:28.873936 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b0ce90e8-5d0a-4be5-85ba-83647a8fda2d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:28.949687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b0ce90e8-5d0a-4be5-85ba-83647a8fda2d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088184 May 12 09:42:28.950315 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 387/768] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 12 09:42:28 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:30.163973 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-74298bba-58c4-4294-bf3c-e765095985a7 req-89a07475-dcd9-4af9-9ef5-981829c757b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8d69574-dc82-4b58-a777-9618741b0e9c", "tag": "ec3b1faa-64e6-47cb-8540-2a02a8bf548c"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:30.172115 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-74298bba-58c4-4294-bf3c-e765095985a7 req-89a07475-dcd9-4af9-9ef5-981829c757b1 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:30.173678 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-74298bba-58c4-4294-bf3c-e765095985a7 req-89a07475-dcd9-4af9-9ef5-981829c757b1 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:30.188103 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-74298bba-58c4-4294-bf3c-e765095985a7 req-89a07475-dcd9-4af9-9ef5-981829c757b1 service nova] Creating event network-changed:ec3b1faa-64e6-47cb-8540-2a02a8bf548c for instance c8d69574-dc82-4b58-a777-9618741b0e9c on hv-cinder-83769 May 12 09:42:30.194061 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-74298bba-58c4-4294-bf3c-e765095985a7 req-89a07475-dcd9-4af9-9ef5-981829c757b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033263 May 12 09:42:30.194658 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 382/769] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:50.598144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b94d7851-0951-453e-8f15-bc18cd6fa204 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:50.598660 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b94d7851-0951-453e-8f15-bc18cd6fa204 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:50.604438 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b94d7851-0951-453e-8f15-bc18cd6fa204 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.604886 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b94d7851-0951-453e-8f15-bc18cd6fa204 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:50.605637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b94d7851-0951-453e-8f15-bc18cd6fa204 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.606106 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b94d7851-0951-453e-8f15-bc18cd6fa204 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:50.683225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-b94d7851-0951-453e-8f15-bc18cd6fa204 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lazy-loading 'services' on Instance uuid 7801a053-99b6-4a9b-9962-1620c14aac30 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:42:50.719976 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-01ffa4bd-bec5-4ca4-90e1-9273f17d0717 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:50.721014 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-01ffa4bd-bec5-4ca4-90e1-9273f17d0717 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:50.727027 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-01ffa4bd-bec5-4ca4-90e1-9273f17d0717 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.727482 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-01ffa4bd-bec5-4ca4-90e1-9273f17d0717 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:50.728258 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-01ffa4bd-bec5-4ca4-90e1-9273f17d0717 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.728698 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-01ffa4bd-bec5-4ca4-90e1-9273f17d0717 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:50.751281 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b94d7851-0951-453e-8f15-bc18cd6fa204 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments/3c5a5735-ebd5-4659-8e32-ee1dcad04354" status: 202 len: 0 microversion: 2.1 time: 0.157971 May 12 09:42:50.751875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 388/770] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:42:50 2022] DELETE /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments/3c5a5735-ebd5-4659-8e32-ee1dcad04354 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:42:50.763497 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-01ffa4bd-bec5-4ca4-90e1-9273f17d0717 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047873 May 12 09:42:50.763692 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-81b149ed-4e83-4921-ad5d-e4e5a06ca83f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:50.764945 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 383/771] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:42:50 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 09:42:50.765074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-81b149ed-4e83-4921-ad5d-e4e5a06ca83f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:50.771674 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-81b149ed-4e83-4921-ad5d-e4e5a06ca83f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.772299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-81b149ed-4e83-4921-ad5d-e4e5a06ca83f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:50.772877 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-81b149ed-4e83-4921-ad5d-e4e5a06ca83f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.773312 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-81b149ed-4e83-4921-ad5d-e4e5a06ca83f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:50.801811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-81b149ed-4e83-4921-ad5d-e4e5a06ca83f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 May 12 09:42:50.802395 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 389/772] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:42:50 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:50.824134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2f1fe175-4bdb-4a55-a904-8f863fa6a6d4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:50.824629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2f1fe175-4bdb-4a55-a904-8f863fa6a6d4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:50.831080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f1fe175-4bdb-4a55-a904-8f863fa6a6d4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.831543 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f1fe175-4bdb-4a55-a904-8f863fa6a6d4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:50.832307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f1fe175-4bdb-4a55-a904-8f863fa6a6d4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.832785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f1fe175-4bdb-4a55-a904-8f863fa6a6d4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:50.857185 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2f1fe175-4bdb-4a55-a904-8f863fa6a6d4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Going to try to terminate instance {{(pid=123509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:42:50.941499 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2f1fe175-4bdb-4a55-a904-8f863fa6a6d4 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 204 len: 0 microversion: 2.1 time: 0.120944 May 12 09:42:50.942188 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 384/773] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:42:50 2022] DELETE /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:42:50.950333 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-df42e04d-a560-4312-92a5-2d8ba4a62ea6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:50.950943 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-df42e04d-a560-4312-92a5-2d8ba4a62ea6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:50.957403 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-df42e04d-a560-4312-92a5-2d8ba4a62ea6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.957786 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-df42e04d-a560-4312-92a5-2d8ba4a62ea6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:50.958639 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-df42e04d-a560-4312-92a5-2d8ba4a62ea6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:50.959072 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-df42e04d-a560-4312-92a5-2d8ba4a62ea6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:51.085594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-df42e04d-a560-4312-92a5-2d8ba4a62ea6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:51.092853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-df42e04d-a560-4312-92a5-2d8ba4a62ea6 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1674 microversion: 2.1 time: 0.146387 May 12 09:42:51.093414 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 390/774] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:50 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:51.815107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b31b9b47-3808-4b8b-a487-b2bc91e84bad tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:51.816104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b31b9b47-3808-4b8b-a487-b2bc91e84bad tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:51.822237 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b31b9b47-3808-4b8b-a487-b2bc91e84bad tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:51.822680 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b31b9b47-3808-4b8b-a487-b2bc91e84bad tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:51.823430 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b31b9b47-3808-4b8b-a487-b2bc91e84bad tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:51.823856 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b31b9b47-3808-4b8b-a487-b2bc91e84bad tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:51.856598 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b31b9b47-3808-4b8b-a487-b2bc91e84bad tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045857 May 12 09:42:51.857157 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 385/775] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:42:51 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:52.109931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-becab078-474c-431d-96f4-5520f74fdc37 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:52.110544 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-becab078-474c-431d-96f4-5520f74fdc37 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:52.117479 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-becab078-474c-431d-96f4-5520f74fdc37 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:52.117960 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-becab078-474c-431d-96f4-5520f74fdc37 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:52.118725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-becab078-474c-431d-96f4-5520f74fdc37 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:52.119165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-becab078-474c-431d-96f4-5520f74fdc37 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:52.249479 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-becab078-474c-431d-96f4-5520f74fdc37 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:52.257250 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-becab078-474c-431d-96f4-5520f74fdc37 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1674 microversion: 2.1 time: 0.151163 May 12 09:42:52.257810 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 391/776] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:52 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:52.867770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-93d87b50-deb6-4af9-b9e5-cb6230a69672 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:52.868722 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-93d87b50-deb6-4af9-b9e5-cb6230a69672 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:52.875037 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-93d87b50-deb6-4af9-b9e5-cb6230a69672 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:52.875495 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-93d87b50-deb6-4af9-b9e5-cb6230a69672 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:52.876264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-93d87b50-deb6-4af9-b9e5-cb6230a69672 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:52.876775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-93d87b50-deb6-4af9-b9e5-cb6230a69672 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:52.908307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-93d87b50-deb6-4af9-b9e5-cb6230a69672 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 May 12 09:42:52.908867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 386/777] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:42:52 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:53.274518 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-82882ce5-064e-4bf8-9c9d-1edb18593e78 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:53.275128 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-82882ce5-064e-4bf8-9c9d-1edb18593e78 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:53.281390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-82882ce5-064e-4bf8-9c9d-1edb18593e78 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:53.281837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-82882ce5-064e-4bf8-9c9d-1edb18593e78 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:53.282622 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-82882ce5-064e-4bf8-9c9d-1edb18593e78 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:53.283542 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-82882ce5-064e-4bf8-9c9d-1edb18593e78 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:53.522173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-82882ce5-064e-4bf8-9c9d-1edb18593e78 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:53.529854 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-82882ce5-064e-4bf8-9c9d-1edb18593e78 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1674 microversion: 2.1 time: 0.259081 May 12 09:42:53.530770 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 392/778] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:53 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1674 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:53.919845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-447d58e7-91c3-40a3-8663-d7c3d7651852 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:53.920775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-447d58e7-91c3-40a3-8663-d7c3d7651852 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:53.927565 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-447d58e7-91c3-40a3-8663-d7c3d7651852 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:53.928044 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-447d58e7-91c3-40a3-8663-d7c3d7651852 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:53.928810 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-447d58e7-91c3-40a3-8663-d7c3d7651852 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:53.929246 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-447d58e7-91c3-40a3-8663-d7c3d7651852 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:53.957408 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-447d58e7-91c3-40a3-8663-d7c3d7651852 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041463 May 12 09:42:53.957979 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 387/779] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:42:53 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 09:42:54.032083 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-082f8386-a1fc-4490-b18b-eeb3219df4e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:54.032581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-082f8386-a1fc-4490-b18b-eeb3219df4e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:54.038370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-082f8386-a1fc-4490-b18b-eeb3219df4e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:54.038823 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-082f8386-a1fc-4490-b18b-eeb3219df4e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:54.039637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-082f8386-a1fc-4490-b18b-eeb3219df4e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:54.040075 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-082f8386-a1fc-4490-b18b-eeb3219df4e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:54.066091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-082f8386-a1fc-4490-b18b-eeb3219df4e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:42:54.153056 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-082f8386-a1fc-4490-b18b-eeb3219df4e3 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 204 len: 0 microversion: 2.1 time: 0.124886 May 12 09:42:54.154329 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 393/780] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:42:54 2022] DELETE /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:42:54.163349 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-73c8e9d6-ad72-4ae7-946f-cdcd74f75501 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:54.164168 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-73c8e9d6-ad72-4ae7-946f-cdcd74f75501 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:54.169348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-d61b457e-e7d0-4bce-8a9f-2ddb4409044f req-f7c3f3d7-02c5-4aaf-965e-d6c0da769d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dadb998-7d24-461d-bf2f-cec5ab30fb48", "name": "network-vif-deleted", "tag": "c4a1fbd1-1e2f-4367-8cd0-c2f3b5182c2b"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:54.171923 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-73c8e9d6-ad72-4ae7-946f-cdcd74f75501 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:54.172914 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-73c8e9d6-ad72-4ae7-946f-cdcd74f75501 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:54.174525 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-73c8e9d6-ad72-4ae7-946f-cdcd74f75501 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:54.174974 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-73c8e9d6-ad72-4ae7-946f-cdcd74f75501 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:54.178320 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-d61b457e-e7d0-4bce-8a9f-2ddb4409044f req-f7c3f3d7-02c5-4aaf-965e-d6c0da769d10 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:54.178820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-d61b457e-e7d0-4bce-8a9f-2ddb4409044f req-f7c3f3d7-02c5-4aaf-965e-d6c0da769d10 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:54.190539 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-d61b457e-e7d0-4bce-8a9f-2ddb4409044f req-f7c3f3d7-02c5-4aaf-965e-d6c0da769d10 service nova] Creating event network-vif-deleted:c4a1fbd1-1e2f-4367-8cd0-c2f3b5182c2b for instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 on hv-cinder-83769 May 12 09:42:54.195891 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-d61b457e-e7d0-4bce-8a9f-2ddb4409044f req-f7c3f3d7-02c5-4aaf-965e-d6c0da769d10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030792 May 12 09:42:54.196772 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 394/781] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:42:54.322325 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-73c8e9d6-ad72-4ae7-946f-cdcd74f75501 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:54.330653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-73c8e9d6-ad72-4ae7-946f-cdcd74f75501 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1689 microversion: 2.1 time: 0.172418 May 12 09:42:54.331666 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 388/782] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:54 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:42:54.548764 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-006a7e22-693e-46ad-b44d-622ab93a4af2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:54.549444 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-006a7e22-693e-46ad-b44d-622ab93a4af2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:54.555516 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-006a7e22-693e-46ad-b44d-622ab93a4af2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:54.555965 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-006a7e22-693e-46ad-b44d-622ab93a4af2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:54.556732 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-006a7e22-693e-46ad-b44d-622ab93a4af2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:54.557165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-006a7e22-693e-46ad-b44d-622ab93a4af2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:54.618587 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-006a7e22-693e-46ad-b44d-622ab93a4af2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:54.625824 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-006a7e22-693e-46ad-b44d-622ab93a4af2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1606 microversion: 2.1 time: 0.081714 May 12 09:42:54.626418 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 395/783] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:54 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1606 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:55.348482 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d80fbb2b-464b-4637-9efc-590fd2e99de2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:55.349143 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d80fbb2b-464b-4637-9efc-590fd2e99de2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:55.355476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d80fbb2b-464b-4637-9efc-590fd2e99de2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:55.355875 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d80fbb2b-464b-4637-9efc-590fd2e99de2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:55.356644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d80fbb2b-464b-4637-9efc-590fd2e99de2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:55.357085 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d80fbb2b-464b-4637-9efc-590fd2e99de2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:55.484884 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d80fbb2b-464b-4637-9efc-590fd2e99de2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:55.492151 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d80fbb2b-464b-4637-9efc-590fd2e99de2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1689 microversion: 2.1 time: 0.148155 May 12 09:42:55.492711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 389/784] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:55 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:55.644557 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-fd8110ef-70d2-4341-87be-622de5cd18ff tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:55.645105 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-fd8110ef-70d2-4341-87be-622de5cd18ff tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:55.651404 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fd8110ef-70d2-4341-87be-622de5cd18ff tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:55.651853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fd8110ef-70d2-4341-87be-622de5cd18ff tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:55.652616 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fd8110ef-70d2-4341-87be-622de5cd18ff tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:55.653052 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fd8110ef-70d2-4341-87be-622de5cd18ff tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:55.715372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-fd8110ef-70d2-4341-87be-622de5cd18ff tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:55.722611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-fd8110ef-70d2-4341-87be-622de5cd18ff tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1606 microversion: 2.1 time: 0.082515 May 12 09:42:55.723173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 396/785] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:55 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1606 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:56.509304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2f7db651-7eb0-48a9-8210-5575d4c943a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:56.510089 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2f7db651-7eb0-48a9-8210-5575d4c943a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:56.516310 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f7db651-7eb0-48a9-8210-5575d4c943a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:56.516774 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f7db651-7eb0-48a9-8210-5575d4c943a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:56.517526 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f7db651-7eb0-48a9-8210-5575d4c943a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:56.517981 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2f7db651-7eb0-48a9-8210-5575d4c943a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:56.641324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2f7db651-7eb0-48a9-8210-5575d4c943a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:56.648934 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2f7db651-7eb0-48a9-8210-5575d4c943a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1689 microversion: 2.1 time: 0.143735 May 12 09:42:56.649495 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 390/786] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:56 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1689 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:56.740063 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:56.740666 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:56.746953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:56.747403 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:56.748158 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:56.748596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:56.778414 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:56.778804 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:56.779248 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lazy-loading 'fault' on Instance uuid 3dadb998-7d24-461d-bf2f-cec5ab30fb48 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:42:56.818113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:56.825172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-eb0ce710-c944-43c7-a52e-f5978b5e7e13 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 200 len: 1327 microversion: 2.1 time: 0.089228 May 12 09:42:56.825759 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 397/787] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:56 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 1327 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:57.666250 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-cdc05a79-1358-41b1-aaa7-8199e95ae7e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:57.667397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-cdc05a79-1358-41b1-aaa7-8199e95ae7e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:57.673821 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cdc05a79-1358-41b1-aaa7-8199e95ae7e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:57.674370 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cdc05a79-1358-41b1-aaa7-8199e95ae7e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:57.675710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cdc05a79-1358-41b1-aaa7-8199e95ae7e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:57.676144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cdc05a79-1358-41b1-aaa7-8199e95ae7e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:57.745046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cdc05a79-1358-41b1-aaa7-8199e95ae7e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:42:57.752368 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-cdc05a79-1358-41b1-aaa7-8199e95ae7e2 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 200 len: 1622 microversion: 2.1 time: 0.089917 May 12 09:42:57.752940 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 391/788] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:57 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 1622 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:42:57.843504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:57.844122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:57.852634 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:57.853498 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:57.854901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:57.855272 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-0ef33aad-95c0-4645-b96e-0d6d45a5b915 req-883f50fd-0d99-4ef9-82d9-58c2fa5ad239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7801a053-99b6-4a9b-9962-1620c14aac30", "name": "network-vif-deleted", "tag": "475e0f9c-a9a4-469d-8d8e-9e0f42721e10"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:57.855570 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:57.865668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-0ef33aad-95c0-4645-b96e-0d6d45a5b915 req-883f50fd-0d99-4ef9-82d9-58c2fa5ad239 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:57.866235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-0ef33aad-95c0-4645-b96e-0d6d45a5b915 req-883f50fd-0d99-4ef9-82d9-58c2fa5ad239 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:57.873830 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] HTTP exception thrown: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Request method failure captured: May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 HTTP/1.1 May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNSGt7-tJ3ngUifuY0pIPlIXxNlwsh59MeQqIW7heJWWR-zSFLUDT8GZindeWgyl44aNsXdx32pfC8HmpkrNt_ym3dp0NehIkZFjuc4lFVoqxQpuVpWG614u7EE6RYp4BF9i9_Iast1cNL4q6adVeD-TYK8NeaWRldJ5mfR9Zf65kVg May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:42:57.875849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da5b9f41ad6b4506872df6cb86ae9f73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}] May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeTestJSON-486367027 May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeTestJSON-486367027-project May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 2efdff1c390f4271963e932af8abd473 May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeTestJSON-486367027-project May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:42:57.877452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '3dadb998-7d24-461d-bf2f-cec5ab30fb48'} May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:42:57.878594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:42:57.880179 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:42:57.882398 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Returning 404 to user: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:42:57.883693 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3a0265f8-01e5-4b48-8576-9db385fcf025 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 404 len: 111 microversion: 2.1 time: 0.044624 May 12 09:42:57.889890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 398/789] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:57 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:42:57.895194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-93d9284c-be73-44d5-bd7d-79607a1e9a8e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '.version_select at 0x7f872b2e3f70>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:57.903153 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-0ef33aad-95c0-4645-b96e-0d6d45a5b915 req-883f50fd-0d99-4ef9-82d9-58c2fa5ad239 service nova] Creating event network-vif-deleted:475e0f9c-a9a4-469d-8d8e-9e0f42721e10 for instance 7801a053-99b6-4a9b-9962-1620c14aac30 on hv-cinder-83769 May 12 09:42:57.910014 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-0ef33aad-95c0-4645-b96e-0d6d45a5b915 req-883f50fd-0d99-4ef9-82d9-58c2fa5ad239 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057731 May 12 09:42:57.911074 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 392/790] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:42:57.947529 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-93d9284c-be73-44d5-bd7d-79607a1e9a8e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044159736" status: 202 len: 0 microversion: 2.1 time: 0.055999 May 12 09:42:57.948443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 399/791] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 12 09:42:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2044159736 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:42:58.775622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:58.777202 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 7801a053-99b6-4a9b-9962-1620c14aac30] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:42:58.785850 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:58.786702 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:58.787665 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:42:58.788170 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:42:58.803193 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] HTTP exception thrown: Instance 7801a053-99b6-4a9b-9962-1620c14aac30 could not be found. May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Request method failure captured: May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 HTTP/1.1 May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNSHHvU-xPgJBPK25GvnemOotOHXGR0HdgQPjtw_xG3Fwc7xiEp59twyMvS4dmFXXond1D1lBsIZB4epBrlw8xntQZNkPOZPFXm1geBWQmpvwFvIdNdGKHmQ25SDCzgUNge48cZXntjNIfKPx_yscMzVLp4b9yU0ICymRlftgT-dJlo May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:42:58.804990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c54669eadc784d4aac5d1a40d18858b1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}] May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 0b01be56426e4ff1a09577f30fb79f0b May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 7801a053-99b6-4a9b-9962-1620c14aac30 could not be found. May 12 09:42:58.806480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '7801a053-99b6-4a9b-9962-1620c14aac30'} May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7801a053-99b6-4a9b-9962-1620c14aac30 could not be found. May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:42:58.810410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7801a053-99b6-4a9b-9962-1620c14aac30 could not be found. May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7801a053-99b6-4a9b-9962-1620c14aac30 could not be found. May 12 09:42:58.812078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:42:58.813445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Returning 404 to user: Instance 7801a053-99b6-4a9b-9962-1620c14aac30 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:42:58.813445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-13679005-1e96-4c4b-818e-86950abe2032 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30" status: 404 len: 111 microversion: 2.1 time: 0.040337 May 12 09:42:58.813445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 393/792] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:42:58 2022] GET /compute/v2.1/servers/7801a053-99b6-4a9b-9962-1620c14aac30 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:42:58.816386 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3ff9a514-ae53-4c32-9211-344968671704 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '.version_select at 0x7f87257a33a0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:42:58.841669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1fbeb92b-a097-4acd-86c9-19063169c0c5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'create', calling method: .version_select at 0x7f8725f7e5e0>, body: {"keypair": {"name": "tempest-keypair-2047819638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM62CJw+RZA8AWQgFYBi3T+T330NamzcUcNjreuc80SRQ6v5bmcXIqQSNhfIW730rpWKD3fGG2lm1X5zla20efqtdCvusfj3D99P2lqVV/98fihB5WePZ5iaUHPyK88ffw=="}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:42:58.843586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3ff9a514-ae53-4c32-9211-344968671704 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024423975" status: 202 len: 0 microversion: 2.1 time: 0.030885 May 12 09:42:58.844509 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 400/793] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 12 09:42:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024423975 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:42:58.858217 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-1fbeb92b-a097-4acd-86c9-19063169c0c5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Getting quotas for project da5b9f41ad6b4506872df6cb86ae9f73. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:42:58.863103 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-1fbeb92b-a097-4acd-86c9-19063169c0c5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Getting quotas for user 2efdff1c390f4271963e932af8abd473 and project da5b9f41ad6b4506872df6cb86ae9f73. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:42:58.891682 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1fbeb92b-a097-4acd-86c9-19063169c0c5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054487 May 12 09:42:58.892417 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 394/794] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:42:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:43:00.253348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-956699156", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "157184d7-26b8-47d5-86e0-3945164ff04d"}], "security_groups": [{"name": "tempest-securitygroup--1004641901"}], "key_name": "tempest-keypair-2047819638", "user_data": "}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:00.350132 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] validate_networks() for [('157184d7-26b8-47d5-86e0-3945164ff04d', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:43:00.703128 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:43:00.703556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:43:00.704033 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:43:00.704445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:43:00.704857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:43:00.713879 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:00.714360 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:00.715161 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:00.715600 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:00.732101 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Getting quotas for project da5b9f41ad6b4506872df6cb86ae9f73. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:43:00.736624 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Getting quotas for user 2efdff1c390f4271963e932af8abd473 and project da5b9f41ad6b4506872df6cb86ae9f73. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:43:00.747393 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:43:00.749627 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:43:00.794865 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ef4e2669-0526-4a4d-b82f-1c8f2139d8fa tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.546302 May 12 09:43:00.795514 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 401/795] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:43:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:43:00.805866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-aa09c01e-143d-4d82-a415-21ee8a1c9aee tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:00.806494 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-aa09c01e-143d-4d82-a415-21ee8a1c9aee tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:00.860981 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-aa09c01e-143d-4d82-a415-21ee8a1c9aee tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:00.868345 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-aa09c01e-143d-4d82-a415-21ee8a1c9aee tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1237 microversion: 2.1 time: 0.066724 May 12 09:43:00.868968 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 395/796] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:00 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:01.886016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-23a417a3-00af-42ae-bbbb-c2e6c882f2a9 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:01.886633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-23a417a3-00af-42ae-bbbb-c2e6c882f2a9 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:01.892636 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-23a417a3-00af-42ae-bbbb-c2e6c882f2a9 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:01.893091 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-23a417a3-00af-42ae-bbbb-c2e6c882f2a9 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:01.894443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-23a417a3-00af-42ae-bbbb-c2e6c882f2a9 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:01.894873 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-23a417a3-00af-42ae-bbbb-c2e6c882f2a9 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:01.967933 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-23a417a3-00af-42ae-bbbb-c2e6c882f2a9 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:01.975144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-23a417a3-00af-42ae-bbbb-c2e6c882f2a9 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1295 microversion: 2.1 time: 0.093792 May 12 09:43:01.975701 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 402/797] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:01 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:02.040906 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e1b04555-cdb3-4e12-a4cc-c568e3180912 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:02.041434 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e1b04555-cdb3-4e12-a4cc-c568e3180912 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:02.047812 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e1b04555-cdb3-4e12-a4cc-c568e3180912 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:02.048267 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e1b04555-cdb3-4e12-a4cc-c568e3180912 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:02.049039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e1b04555-cdb3-4e12-a4cc-c568e3180912 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:02.049481 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e1b04555-cdb3-4e12-a4cc-c568e3180912 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:02.075151 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e1b04555-cdb3-4e12-a4cc-c568e3180912 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Going to try to terminate instance {{(pid=123509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:43:02.149529 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e1b04555-cdb3-4e12-a4cc-c568e3180912 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "DELETE /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 204 len: 0 microversion: 2.1 time: 0.111881 May 12 09:43:02.150071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 396/798] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:43:02 2022] DELETE /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:43:02.158122 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-485df345-2a2d-48bc-bf5a-288a7ef2517b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:02.159016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-485df345-2a2d-48bc-bf5a-288a7ef2517b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:02.172806 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-485df345-2a2d-48bc-bf5a-288a7ef2517b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:02.173256 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-485df345-2a2d-48bc-bf5a-288a7ef2517b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:02.174069 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-485df345-2a2d-48bc-bf5a-288a7ef2517b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:02.174504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-485df345-2a2d-48bc-bf5a-288a7ef2517b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:02.364676 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-485df345-2a2d-48bc-bf5a-288a7ef2517b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:02.372808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-485df345-2a2d-48bc-bf5a-288a7ef2517b tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1507 microversion: 2.1 time: 0.218490 May 12 09:43:02.373381 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 403/799] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:02 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:02.992533 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0cfe3ae0-242d-4f0f-afb1-2208486b4958 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:02.993138 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0cfe3ae0-242d-4f0f-afb1-2208486b4958 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:02.998985 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0cfe3ae0-242d-4f0f-afb1-2208486b4958 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:02.999441 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0cfe3ae0-242d-4f0f-afb1-2208486b4958 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:03.000214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0cfe3ae0-242d-4f0f-afb1-2208486b4958 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:03.000654 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0cfe3ae0-242d-4f0f-afb1-2208486b4958 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:03.193005 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0cfe3ae0-242d-4f0f-afb1-2208486b4958 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:03.200157 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0cfe3ae0-242d-4f0f-afb1-2208486b4958 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1363 microversion: 2.1 time: 0.212004 May 12 09:43:03.200723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 397/800] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:02 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:03.390686 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ed406f77-5421-42a7-acc3-a3e0ec301879 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:03.391899 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ed406f77-5421-42a7-acc3-a3e0ec301879 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:03.400107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ed406f77-5421-42a7-acc3-a3e0ec301879 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:03.401057 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ed406f77-5421-42a7-acc3-a3e0ec301879 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:03.402344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ed406f77-5421-42a7-acc3-a3e0ec301879 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:03.402887 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ed406f77-5421-42a7-acc3-a3e0ec301879 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:03.505180 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-89d762aa-8e46-44bb-8c15-670d93438425 req-80abba00-f450-4b2f-a6c1-249825b85516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa", "tag": "953ead63-0e69-4d22-b2b3-ae09ec6491e1"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:03.531630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-89d762aa-8e46-44bb-8c15-670d93438425 req-80abba00-f450-4b2f-a6c1-249825b85516 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:03.532080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-89d762aa-8e46-44bb-8c15-670d93438425 req-80abba00-f450-4b2f-a6c1-249825b85516 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:03.548300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-89d762aa-8e46-44bb-8c15-670d93438425 req-80abba00-f450-4b2f-a6c1-249825b85516 service nova] Creating event network-changed:953ead63-0e69-4d22-b2b3-ae09ec6491e1 for instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa on hv-cinder-83769 May 12 09:43:03.554860 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-89d762aa-8e46-44bb-8c15-670d93438425 req-80abba00-f450-4b2f-a6c1-249825b85516 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056730 May 12 09:43:03.555779 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 398/801] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:43:03.736718 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ed406f77-5421-42a7-acc3-a3e0ec301879 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:03.746895 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ed406f77-5421-42a7-acc3-a3e0ec301879 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 200 len: 1507 microversion: 2.1 time: 0.360629 May 12 09:43:03.764926 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-f2089f5f-203f-4393-874d-7e96bbd6cd3c req-6ecc3510-757a-4ec8-a20f-78a198837b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53d9ed2f-fe3d-46fc-a250-33724264ef93", "name": "network-vif-deleted", "tag": "35189b62-b72a-41d7-be6e-95a6288505a1"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:03.765630 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 404/802] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:03 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:03.776247 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-f2089f5f-203f-4393-874d-7e96bbd6cd3c req-6ecc3510-757a-4ec8-a20f-78a198837b31 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:03.776690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-f2089f5f-203f-4393-874d-7e96bbd6cd3c req-6ecc3510-757a-4ec8-a20f-78a198837b31 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:03.793508 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-f2089f5f-203f-4393-874d-7e96bbd6cd3c req-6ecc3510-757a-4ec8-a20f-78a198837b31 service nova] Creating event network-vif-deleted:35189b62-b72a-41d7-be6e-95a6288505a1 for instance 53d9ed2f-fe3d-46fc-a250-33724264ef93 on hv-cinder-83769 May 12 09:43:03.801267 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-f2089f5f-203f-4393-874d-7e96bbd6cd3c req-6ecc3510-757a-4ec8-a20f-78a198837b31 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042099 May 12 09:43:03.802235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 399/803] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:43:04.216288 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a5710f32-8d36-4631-b63e-3e3ea69b0c6b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:04.217019 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a5710f32-8d36-4631-b63e-3e3ea69b0c6b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:04.223618 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a5710f32-8d36-4631-b63e-3e3ea69b0c6b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:04.224067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a5710f32-8d36-4631-b63e-3e3ea69b0c6b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:04.225197 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a5710f32-8d36-4631-b63e-3e3ea69b0c6b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:04.225640 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a5710f32-8d36-4631-b63e-3e3ea69b0c6b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:04.363893 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a5710f32-8d36-4631-b63e-3e3ea69b0c6b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:04.371090 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a5710f32-8d36-4631-b63e-3e3ea69b0c6b tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1363 microversion: 2.1 time: 0.158622 May 12 09:43:04.371644 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 405/804] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:04 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:04.766363 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:04.767059 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 53d9ed2f-fe3d-46fc-a250-33724264ef93] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:04.773530 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:04.774016 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:04.774784 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:04.775217 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:04.788516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] HTTP exception thrown: Instance 53d9ed2f-fe3d-46fc-a250-33724264ef93 could not be found. May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Request method failure captured: May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 HTTP/1.1 May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNSHHvU-xPgJBPK25GvnemOotOHXGR0HdgQPjtw_xG3Fwc7xiEp59twyMvS4dmFXXond1D1lBsIZB4epBrlw8xntQZNkPOZPFXm1geBWQmpvwFvIdNdGKHmQ25SDCzgUNge48cZXntjNIfKPx_yscMzVLp4b9yU0ICymRlftgT-dJlo May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:43:04.790145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c54669eadc784d4aac5d1a40d18858b1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}] May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 0b01be56426e4ff1a09577f30fb79f0b May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 53d9ed2f-fe3d-46fc-a250-33724264ef93 could not be found. May 12 09:43:04.791700 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '53d9ed2f-fe3d-46fc-a250-33724264ef93'} May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53d9ed2f-fe3d-46fc-a250-33724264ef93 could not be found. May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:43:04.792715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53d9ed2f-fe3d-46fc-a250-33724264ef93 could not be found. May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53d9ed2f-fe3d-46fc-a250-33724264ef93 could not be found. May 12 09:43:04.794187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:43:04.795610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Returning 404 to user: Instance 53d9ed2f-fe3d-46fc-a250-33724264ef93 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:43:04.795610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4999abc4-8d00-439d-848b-9b79af0a5a6f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93" status: 404 len: 111 microversion: 2.1 time: 0.029356 May 12 09:43:04.795610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 400/805] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:04 2022] GET /compute/v2.1/servers/53d9ed2f-fe3d-46fc-a250-33724264ef93 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:43:04.803714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f6071909-4fc9-4e2d-a24b-5197427e783f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:04.804242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f6071909-4fc9-4e2d-a24b-5197427e783f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:04.811971 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f6071909-4fc9-4e2d-a24b-5197427e783f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:04.812799 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f6071909-4fc9-4e2d-a24b-5197427e783f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:04.813605 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f6071909-4fc9-4e2d-a24b-5197427e783f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:04.814085 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f6071909-4fc9-4e2d-a24b-5197427e783f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:04.842163 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f6071909-4fc9-4e2d-a24b-5197427e783f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:43:04.913494 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f6071909-4fc9-4e2d-a24b-5197427e783f tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 204 len: 0 microversion: 2.1 time: 0.117224 May 12 09:43:04.914088 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 406/806] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:43:04 2022] DELETE /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:43:04.922037 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d4b62623-439c-4aa6-ada6-d9c712ac7922 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:04.922679 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d4b62623-439c-4aa6-ada6-d9c712ac7922 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:04.929197 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4b62623-439c-4aa6-ada6-d9c712ac7922 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:04.929642 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4b62623-439c-4aa6-ada6-d9c712ac7922 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:04.930438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4b62623-439c-4aa6-ada6-d9c712ac7922 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:04.931060 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4b62623-439c-4aa6-ada6-d9c712ac7922 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:05.058805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d4b62623-439c-4aa6-ada6-d9c712ac7922 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:05.065924 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d4b62623-439c-4aa6-ada6-d9c712ac7922 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.147762 May 12 09:43:05.066475 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 401/807] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:04 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:43:05.388634 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c52c22ed-1136-4d37-97b4-307b1e342397 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:05.389230 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c52c22ed-1136-4d37-97b4-307b1e342397 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:05.395784 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c52c22ed-1136-4d37-97b4-307b1e342397 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:05.396230 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c52c22ed-1136-4d37-97b4-307b1e342397 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:05.396982 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c52c22ed-1136-4d37-97b4-307b1e342397 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:05.397408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c52c22ed-1136-4d37-97b4-307b1e342397 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:05.524050 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c52c22ed-1136-4d37-97b4-307b1e342397 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:05.531384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c52c22ed-1136-4d37-97b4-307b1e342397 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1363 microversion: 2.1 time: 0.147120 May 12 09:43:05.531944 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 407/808] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:05 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:06.082964 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-326d3aca-d99c-420b-80b9-22170fa739c8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:06.083576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-326d3aca-d99c-420b-80b9-22170fa739c8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:06.089871 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-326d3aca-d99c-420b-80b9-22170fa739c8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:06.090362 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-326d3aca-d99c-420b-80b9-22170fa739c8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:06.091133 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-326d3aca-d99c-420b-80b9-22170fa739c8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:06.091574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-326d3aca-d99c-420b-80b9-22170fa739c8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:06.215957 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-326d3aca-d99c-420b-80b9-22170fa739c8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:06.223563 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-326d3aca-d99c-420b-80b9-22170fa739c8 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.144492 May 12 09:43:06.224225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 402/809] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:06 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:43:06.547988 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2bcdc129-745f-48df-8c8e-3d1ba6fd0dea tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:06.548640 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2bcdc129-745f-48df-8c8e-3d1ba6fd0dea tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:06.555024 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2bcdc129-745f-48df-8c8e-3d1ba6fd0dea tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:06.555468 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2bcdc129-745f-48df-8c8e-3d1ba6fd0dea tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:06.556221 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2bcdc129-745f-48df-8c8e-3d1ba6fd0dea tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:06.556658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2bcdc129-745f-48df-8c8e-3d1ba6fd0dea tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:06.843956 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2bcdc129-745f-48df-8c8e-3d1ba6fd0dea tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:06.851133 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2bcdc129-745f-48df-8c8e-3d1ba6fd0dea tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1363 microversion: 2.1 time: 0.306920 May 12 09:43:06.851685 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 408/810] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:06 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:07.241656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ebc7f554-1f91-444e-a088-bd3f9e0e16a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:07.242322 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ebc7f554-1f91-444e-a088-bd3f9e0e16a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:07.249706 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ebc7f554-1f91-444e-a088-bd3f9e0e16a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:07.250199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ebc7f554-1f91-444e-a088-bd3f9e0e16a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:07.250972 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ebc7f554-1f91-444e-a088-bd3f9e0e16a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:07.251413 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ebc7f554-1f91-444e-a088-bd3f9e0e16a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:07.437948 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ebc7f554-1f91-444e-a088-bd3f9e0e16a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:07.446433 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ebc7f554-1f91-444e-a088-bd3f9e0e16a9 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1522 microversion: 2.1 time: 0.208993 May 12 09:43:07.448101 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 403/811] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:07 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:07.868434 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5f2495de-ea5c-4984-aa34-62bb3d0faaa5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:07.869045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5f2495de-ea5c-4984-aa34-62bb3d0faaa5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:07.875402 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f2495de-ea5c-4984-aa34-62bb3d0faaa5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:07.875851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f2495de-ea5c-4984-aa34-62bb3d0faaa5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:07.876616 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f2495de-ea5c-4984-aa34-62bb3d0faaa5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:07.877061 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f2495de-ea5c-4984-aa34-62bb3d0faaa5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:08.067068 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5f2495de-ea5c-4984-aa34-62bb3d0faaa5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:08.074326 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5f2495de-ea5c-4984-aa34-62bb3d0faaa5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1363 microversion: 2.1 time: 0.209729 May 12 09:43:08.074889 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 409/812] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:07 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:08.444476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-0d157b28-3c5a-4c98-8f20-422d6742e670 req-9681528a-194f-4c54-b972-ed80f662806d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed911f6-afdf-49e6-9897-e51a903b7680", "name": "network-vif-deleted", "tag": "d8e31c88-6d60-467b-8eec-0d8851da1ced"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:08.454428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-0d157b28-3c5a-4c98-8f20-422d6742e670 req-9681528a-194f-4c54-b972-ed80f662806d service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:08.454865 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-0d157b28-3c5a-4c98-8f20-422d6742e670 req-9681528a-194f-4c54-b972-ed80f662806d service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:08.463691 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-69cf1ec5-9eaa-4195-befc-41b928fe947c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:08.464469 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-69cf1ec5-9eaa-4195-befc-41b928fe947c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:08.467740 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-0d157b28-3c5a-4c98-8f20-422d6742e670 req-9681528a-194f-4c54-b972-ed80f662806d service nova] Creating event network-vif-deleted:d8e31c88-6d60-467b-8eec-0d8851da1ced for instance 4ed911f6-afdf-49e6-9897-e51a903b7680 on hv-cinder-83769 May 12 09:43:08.471104 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69cf1ec5-9eaa-4195-befc-41b928fe947c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:08.472636 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69cf1ec5-9eaa-4195-befc-41b928fe947c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:08.473525 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69cf1ec5-9eaa-4195-befc-41b928fe947c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:08.473735 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-0d157b28-3c5a-4c98-8f20-422d6742e670 req-9681528a-194f-4c54-b972-ed80f662806d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033164 May 12 09:43:08.474104 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-69cf1ec5-9eaa-4195-befc-41b928fe947c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:08.474619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 404/813] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:08.538743 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-69cf1ec5-9eaa-4195-befc-41b928fe947c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b01be56426e4ff1a09577f30fb79f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c54669eadc784d4aac5d1a40d18858b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:08.546438 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-69cf1ec5-9eaa-4195-befc-41b928fe947c tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 200 len: 1307 microversion: 2.1 time: 0.086891 May 12 09:43:08.547005 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 410/814] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:08 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 1307 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:43:09.092362 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-609aa6a8-3787-4cb1-9b8d-bf6a93411112 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:09.093125 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-609aa6a8-3787-4cb1-9b8d-bf6a93411112 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:09.099609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-609aa6a8-3787-4cb1-9b8d-bf6a93411112 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:09.100065 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-609aa6a8-3787-4cb1-9b8d-bf6a93411112 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:09.101015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-609aa6a8-3787-4cb1-9b8d-bf6a93411112 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:09.101886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-609aa6a8-3787-4cb1-9b8d-bf6a93411112 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:09.228694 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-609aa6a8-3787-4cb1-9b8d-bf6a93411112 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:09.236020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-609aa6a8-3787-4cb1-9b8d-bf6a93411112 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1363 microversion: 2.1 time: 0.147752 May 12 09:43:09.236592 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 405/815] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:09 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:09.563722 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:09.564467 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] [instance: 4ed911f6-afdf-49e6-9897-e51a903b7680] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:09.570931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:09.571384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:09.572154 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:09.573009 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:09.585609 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] HTTP exception thrown: Instance 4ed911f6-afdf-49e6-9897-e51a903b7680 could not be found. May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Request method failure captured: May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 HTTP/1.1 May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNSHHvU-xPgJBPK25GvnemOotOHXGR0HdgQPjtw_xG3Fwc7xiEp59twyMvS4dmFXXond1D1lBsIZB4epBrlw8xntQZNkPOZPFXm1geBWQmpvwFvIdNdGKHmQ25SDCzgUNge48cZXntjNIfKPx_yscMzVLp4b9yU0ICymRlftgT-dJlo May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:43:09.587275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c54669eadc784d4aac5d1a40d18858b1", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c54669eadc784d4aac5d1a40d18858b1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c54669eadc784d4aac5d1a40d18858b1"}]}] May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: c54669eadc784d4aac5d1a40d18858b1 May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-895700050 May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 0b01be56426e4ff1a09577f30fb79f0b May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-ServerRescueNegativeTestJSON-895700050-project May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance 4ed911f6-afdf-49e6-9897-e51a903b7680 could not be found. May 12 09:43:09.588777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '4ed911f6-afdf-49e6-9897-e51a903b7680'} May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed911f6-afdf-49e6-9897-e51a903b7680 could not be found. May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:43:09.589781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed911f6-afdf-49e6-9897-e51a903b7680 could not be found. May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed911f6-afdf-49e6-9897-e51a903b7680 could not be found. May 12 09:43:09.591151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:43:09.592445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] Returning 404 to user: Instance 4ed911f6-afdf-49e6-9897-e51a903b7680 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:43:09.592445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5554779b-81c1-4ee8-b978-0afcca37ed61 tempest-ServerRescueNegativeTestJSON-895700050 tempest-ServerRescueNegativeTestJSON-895700050-project] 10.222.0.60 "GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680" status: 404 len: 111 microversion: 2.1 time: 0.028988 May 12 09:43:09.592968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 411/816] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:09 2022] GET /compute/v2.1/servers/4ed911f6-afdf-49e6-9897-e51a903b7680 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:43:09.711022 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-3a6fc635-fdbb-46c6-9e28-6c4754bba1de req-da5c17e6-4765-4fe8-aae8-8345211de73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa", "name": "network-vif-plugged", "status": "completed", "tag": "953ead63-0e69-4d22-b2b3-ae09ec6491e1"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:09.719209 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-3a6fc635-fdbb-46c6-9e28-6c4754bba1de req-da5c17e6-4765-4fe8-aae8-8345211de73a service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:09.719658 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-3a6fc635-fdbb-46c6-9e28-6c4754bba1de req-da5c17e6-4765-4fe8-aae8-8345211de73a service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:09.732988 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-3a6fc635-fdbb-46c6-9e28-6c4754bba1de req-da5c17e6-4765-4fe8-aae8-8345211de73a service nova] Creating event network-vif-plugged:953ead63-0e69-4d22-b2b3-ae09ec6491e1 for instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa on hv-cinder-83769 May 12 09:43:09.739920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-3a6fc635-fdbb-46c6-9e28-6c4754bba1de req-da5c17e6-4765-4fe8-aae8-8345211de73a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032048 May 12 09:43:09.740701 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 406/817] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:10.254084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8fdc45ec-735f-4388-8c63-5fabbadc484e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:10.254728 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8fdc45ec-735f-4388-8c63-5fabbadc484e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:10.261173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8fdc45ec-735f-4388-8c63-5fabbadc484e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:10.261612 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8fdc45ec-735f-4388-8c63-5fabbadc484e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:10.262407 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8fdc45ec-735f-4388-8c63-5fabbadc484e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:10.262841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8fdc45ec-735f-4388-8c63-5fabbadc484e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:10.569599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8fdc45ec-735f-4388-8c63-5fabbadc484e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:10.577056 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8fdc45ec-735f-4388-8c63-5fabbadc484e tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1363 microversion: 2.1 time: 0.326762 May 12 09:43:10.577607 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 412/818] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:10 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:11.596137 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-020fac88-87f6-4fbe-a0a6-5fd17b86c123 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:11.597332 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-020fac88-87f6-4fbe-a0a6-5fd17b86c123 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:11.604054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-020fac88-87f6-4fbe-a0a6-5fd17b86c123 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:11.604707 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-020fac88-87f6-4fbe-a0a6-5fd17b86c123 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:11.605661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-020fac88-87f6-4fbe-a0a6-5fd17b86c123 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:11.606146 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-020fac88-87f6-4fbe-a0a6-5fd17b86c123 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:11.832153 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-020fac88-87f6-4fbe-a0a6-5fd17b86c123 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:11.840475 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-020fac88-87f6-4fbe-a0a6-5fd17b86c123 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1548 microversion: 2.1 time: 0.249415 May 12 09:43:11.841372 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 407/819] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:11 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1548 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:11.859819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5649b257-0cd6-47f3-9cd5-9183e42e7ebc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:11.860508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5649b257-0cd6-47f3-9cd5-9183e42e7ebc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:11.866998 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5649b257-0cd6-47f3-9cd5-9183e42e7ebc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:11.867667 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5649b257-0cd6-47f3-9cd5-9183e42e7ebc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:11.868455 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5649b257-0cd6-47f3-9cd5-9183e42e7ebc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:11.868901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5649b257-0cd6-47f3-9cd5-9183e42e7ebc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:11.995099 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5649b257-0cd6-47f3-9cd5-9183e42e7ebc tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140958 May 12 09:43:11.996015 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 413/820] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 12 09:43:11 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:13.012538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-228b2e8b-3558-4155-9cfd-c0928c64f139 req-fa24d6ab-4253-4854-8d4c-59383eab709e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa", "tag": "953ead63-0e69-4d22-b2b3-ae09ec6491e1"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:13.021019 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-228b2e8b-3558-4155-9cfd-c0928c64f139 req-fa24d6ab-4253-4854-8d4c-59383eab709e service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:13.021631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-228b2e8b-3558-4155-9cfd-c0928c64f139 req-fa24d6ab-4253-4854-8d4c-59383eab709e service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:13.033288 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-228b2e8b-3558-4155-9cfd-c0928c64f139 req-fa24d6ab-4253-4854-8d4c-59383eab709e service nova] Creating event network-changed:953ead63-0e69-4d22-b2b3-ae09ec6491e1 for instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa on hv-cinder-83769 May 12 09:43:13.040160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-228b2e8b-3558-4155-9cfd-c0928c64f139 req-fa24d6ab-4253-4854-8d4c-59383eab709e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031896 May 12 09:43:13.043984 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 408/821] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:19.044443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cb572349-76e1-4b3e-bdb8-13e65ec1dd56 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'create', calling method: .version_select at 0x7f872b2e3ca0>, body: {"keypair": {"name": "tempest-keypair-1924939188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvKTRqBjBj16OwLZd4aMzudJdhVZfX0AEosSh6CwEoYgWz5i76nrE2NSRIG34Y4J2ZFxDhSexSJcX7I4sNX1oyldpD3PDsT9qSq4d2JmImACTpAjWwV2lRHdEAtr0jymg=="}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:19.064630 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-cb572349-76e1-4b3e-bdb8-13e65ec1dd56 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Getting quotas for project b879e240eb4f48139e28cc43223b21da. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:43:19.068917 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-cb572349-76e1-4b3e-bdb8-13e65ec1dd56 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Getting quotas for user f739359acd844279aa56ef7d69f4c299 and project b879e240eb4f48139e28cc43223b21da. Resources: {'key_pairs'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:43:19.098417 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cb572349-76e1-4b3e-bdb8-13e65ec1dd56 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.186087 May 12 09:43:19.099103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 414/822] 10.222.0.60 () {62 vars in 1199 bytes} [Thu May 12 09:43:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 09:43:20.653621 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1792023353", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e493ca3-e280-43b9-b225-da7bca606395"}], "security_groups": [{"name": "tempest-securitygroup--2079925918"}], "key_name": "tempest-keypair-1924939188", "user_data": "}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:20.770123 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] validate_networks() for [('9e493ca3-e280-43b9-b225-da7bca606395', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:43:21.178350 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:43:21.178803 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:43:21.179271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:43:21.179675 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:43:21.180083 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:43:21.188599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:21.189042 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:21.190373 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:21.190808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:21.207067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Getting quotas for project b879e240eb4f48139e28cc43223b21da. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:43:21.210896 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Getting quotas for user f739359acd844279aa56ef7d69f4c299 and project b879e240eb4f48139e28cc43223b21da. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:43:21.221460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:43:21.223807 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:43:21.273371 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4d28d42d-4410-49d3-b468-a4da8dda35d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.624871 May 12 09:43:21.274218 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 409/823] 10.222.0.60 () {62 vars in 1187 bytes} [Thu May 12 09:43:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 09:43:21.284050 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-73b10e8b-aeaf-47c4-8698-e30bab06810a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:21.285352 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-73b10e8b-aeaf-47c4-8698-e30bab06810a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:21.356099 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-73b10e8b-aeaf-47c4-8698-e30bab06810a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:21.365675 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-73b10e8b-aeaf-47c4-8698-e30bab06810a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:21.367816 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-73b10e8b-aeaf-47c4-8698-e30bab06810a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:21.369801 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-73b10e8b-aeaf-47c4-8698-e30bab06810a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1282 microversion: 2.20 time: 0.089480 May 12 09:43:21.370551 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 415/824] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:21 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:22.397812 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:22.398399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:22.406889 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:22.407583 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:22.409116 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:22.409750 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:22.510015 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:22.521073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:22.527947 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:22.529376 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-96f5ed12-eebb-4670-b8e3-3cb08f7c96be tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1342 microversion: 2.20 time: 0.136701 May 12 09:43:22.530177 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 410/825] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:22 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1342 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:23.548337 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:23.549775 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:23.556737 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:23.557471 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:23.558501 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:23.559299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:23.775311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:23.783227 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:23.786176 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:23.787525 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a2ddf668-bfec-42c9-b304-c6706ad67a72 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1408 microversion: 2.20 time: 0.243206 May 12 09:43:23.798164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 416/826] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:23 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:23.999697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-4ad89195-602f-4fd5-b53e-c095fd6ea580 req-20258d0c-85fb-4823-afee-7a4d751051e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18552b7d-9ecc-4182-b0fd-726899815dcf", "tag": "b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:24.010860 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-4ad89195-602f-4fd5-b53e-c095fd6ea580 req-20258d0c-85fb-4823-afee-7a4d751051e7 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:24.011302 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-4ad89195-602f-4fd5-b53e-c095fd6ea580 req-20258d0c-85fb-4823-afee-7a4d751051e7 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:24.029278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-4ad89195-602f-4fd5-b53e-c095fd6ea580 req-20258d0c-85fb-4823-afee-7a4d751051e7 service nova] Creating event network-changed:b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b for instance 18552b7d-9ecc-4182-b0fd-726899815dcf on hv-cinder-83769 May 12 09:43:24.035049 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-4ad89195-602f-4fd5-b53e-c095fd6ea580 req-20258d0c-85fb-4823-afee-7a4d751051e7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040540 May 12 09:43:24.035683 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 411/827] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:24.806086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:24.806691 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:24.812983 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:24.813446 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:24.814306 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:24.815358 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:24.937923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:24.945702 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:24.947145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:24.948233 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-27c412bb-c455-4840-b633-0ad844061fe9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1408 microversion: 2.20 time: 0.146067 May 12 09:43:24.948773 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 417/828] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:24 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:25.966486 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:25.967181 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:25.973796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:25.974274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:25.975040 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:25.975479 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:26.105174 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:26.113321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:26.114861 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:26.115952 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1980b39f-bb28-4388-bd58-cffdab50964e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1408 microversion: 2.20 time: 0.154259 May 12 09:43:26.116502 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 412/829] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:25 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:27.134110 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:27.134711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:27.140755 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:27.141218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:27.141977 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:27.142411 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:27.361137 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:27.369435 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:27.370960 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:27.372054 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-50524378-fbae-4cd8-b5a3-916f1b069575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1408 microversion: 2.20 time: 0.242130 May 12 09:43:27.372596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 418/830] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:27 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:28.389782 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:28.390407 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:28.396616 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:28.397066 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:28.397858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:28.398325 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:28.523111 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:28.530775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:28.532254 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:28.533332 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-47c37a58-15e7-40a1-9b56-7dae8be63b50 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1408 microversion: 2.20 time: 0.147520 May 12 09:43:28.533885 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 413/831] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:28 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:29.551227 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:29.551828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:29.557984 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:29.558435 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:29.559189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:29.559634 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:29.691708 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:29.699893 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:29.701396 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:29.702520 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-db65886d-96a1-40fe-bda5-f2a74f71e78a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1408 microversion: 2.20 time: 0.155790 May 12 09:43:29.703073 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 419/832] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:29 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:30.285783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e2c58771-cf1b-407b-b39b-6a62f0213994 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:30.286492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e2c58771-cf1b-407b-b39b-6a62f0213994 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:30.292557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2c58771-cf1b-407b-b39b-6a62f0213994 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:30.293006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2c58771-cf1b-407b-b39b-6a62f0213994 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:30.293777 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2c58771-cf1b-407b-b39b-6a62f0213994 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:30.294243 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2c58771-cf1b-407b-b39b-6a62f0213994 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:30.316596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-e2c58771-cf1b-407b-b39b-6a62f0213994 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lazy-loading 'flavor' on Instance uuid 5697f44b-088d-48ee-89a1-ae6d09f7d47f {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:43:30.421669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e2c58771-cf1b-407b-b39b-6a62f0213994 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "POST /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f/action" status: 202 len: 0 microversion: 2.1 time: 0.140155 May 12 09:43:30.422200 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 414/833] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:43:30 2022] POST /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:43:30.431834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1709b6cc-e71d-455f-9e9a-56b4c0404963 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:30.432434 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1709b6cc-e71d-455f-9e9a-56b4c0404963 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:30.438811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1709b6cc-e71d-455f-9e9a-56b4c0404963 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:30.439326 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1709b6cc-e71d-455f-9e9a-56b4c0404963 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:30.440129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1709b6cc-e71d-455f-9e9a-56b4c0404963 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:30.440574 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1709b6cc-e71d-455f-9e9a-56b4c0404963 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:30.566570 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1709b6cc-e71d-455f-9e9a-56b4c0404963 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:30.573702 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1709b6cc-e71d-455f-9e9a-56b4c0404963 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.146046 May 12 09:43:30.574285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 420/834] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:30 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:30.722000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:30.722583 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:30.728627 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:30.729076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:30.729836 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:30.730294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:30.857089 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:30.865373 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:30.866893 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:30.867983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-53cc7e01-3b58-4126-9b09-aaa5ffce39ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1408 microversion: 2.20 time: 0.151214 May 12 09:43:30.868549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 415/835] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:30 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:31.591786 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-be193057-3f67-479d-bf9b-d9e27e298ef2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:31.592395 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-be193057-3f67-479d-bf9b-d9e27e298ef2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:31.599051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-be193057-3f67-479d-bf9b-d9e27e298ef2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:31.599505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-be193057-3f67-479d-bf9b-d9e27e298ef2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:31.600283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-be193057-3f67-479d-bf9b-d9e27e298ef2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:31.600725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-be193057-3f67-479d-bf9b-d9e27e298ef2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:31.700720 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-557704b1-a4ab-4f9f-8f35-5aef66730bb5 req-3364a1b6-4236-4234-a4b6-2854e237d0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18552b7d-9ecc-4182-b0fd-726899815dcf", "name": "network-vif-plugged", "status": "completed", "tag": "b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:31.710549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-557704b1-a4ab-4f9f-8f35-5aef66730bb5 req-3364a1b6-4236-4234-a4b6-2854e237d0f0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:31.711092 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-557704b1-a4ab-4f9f-8f35-5aef66730bb5 req-3364a1b6-4236-4234-a4b6-2854e237d0f0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:31.723891 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-557704b1-a4ab-4f9f-8f35-5aef66730bb5 req-3364a1b6-4236-4234-a4b6-2854e237d0f0 service nova] Creating event network-vif-plugged:b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b for instance 18552b7d-9ecc-4182-b0fd-726899815dcf on hv-cinder-83769 May 12 09:43:31.728973 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-557704b1-a4ab-4f9f-8f35-5aef66730bb5 req-3364a1b6-4236-4234-a4b6-2854e237d0f0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032007 May 12 09:43:31.730025 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 416/836] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:31.737725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-be193057-3f67-479d-bf9b-d9e27e298ef2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:31.749035 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-be193057-3f67-479d-bf9b-d9e27e298ef2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.161088 May 12 09:43:31.751515 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 421/837] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:31 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:31.887675 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:31.888279 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:31.896249 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:31.897009 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:31.897935 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:31.898371 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:32.073274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:32.081064 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:32.082603 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:32.083682 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-dfbd401d-dc60-4f09-adc4-45a126675d42 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1408 microversion: 2.20 time: 0.201846 May 12 09:43:32.084244 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 417/838] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:31 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:32.766291 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4b60d0e6-e883-49a0-9a9e-3d397b324e1c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:32.766900 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4b60d0e6-e883-49a0-9a9e-3d397b324e1c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:32.773678 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4b60d0e6-e883-49a0-9a9e-3d397b324e1c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:32.774165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4b60d0e6-e883-49a0-9a9e-3d397b324e1c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:32.774927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4b60d0e6-e883-49a0-9a9e-3d397b324e1c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:32.775357 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4b60d0e6-e883-49a0-9a9e-3d397b324e1c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:32.899771 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4b60d0e6-e883-49a0-9a9e-3d397b324e1c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:32.907025 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4b60d0e6-e883-49a0-9a9e-3d397b324e1c tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.144578 May 12 09:43:32.907577 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 422/839] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:32 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:33.100609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:33.101212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:33.107576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:33.108025 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:33.108787 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:33.109217 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:33.230662 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:33.238218 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:33.239699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:33.240778 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-364fcc7d-4118-4a08-96b6-e3ef0e5f5575 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1408 microversion: 2.20 time: 0.144194 May 12 09:43:33.241332 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 418/840] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:33 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:33.925133 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c20999f1-b715-4301-b384-e664ce948473 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:33.925739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c20999f1-b715-4301-b384-e664ce948473 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:33.931980 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c20999f1-b715-4301-b384-e664ce948473 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:33.932424 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c20999f1-b715-4301-b384-e664ce948473 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:33.933177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c20999f1-b715-4301-b384-e664ce948473 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:33.933607 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c20999f1-b715-4301-b384-e664ce948473 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:34.065317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c20999f1-b715-4301-b384-e664ce948473 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:34.072548 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c20999f1-b715-4301-b384-e664ce948473 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.151912 May 12 09:43:34.073189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 423/841] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:33 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:34.258781 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:34.259391 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:34.265643 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:34.266139 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:34.266898 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:34.267331 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:34.391749 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:34.400644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:34.402461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:34.403607 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9472f523-fc99-4dad-aba8-1db03f7a6dd0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1600 microversion: 2.20 time: 0.149014 May 12 09:43:34.404174 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 419/842] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:43:34 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:43:34.421707 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d7cce2e0-2bbf-465d-85e8-36314e835f65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:34.422226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d7cce2e0-2bbf-465d-85e8-36314e835f65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:34.428015 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d7cce2e0-2bbf-465d-85e8-36314e835f65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:34.428457 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d7cce2e0-2bbf-465d-85e8-36314e835f65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:34.429219 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d7cce2e0-2bbf-465d-85e8-36314e835f65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:34.429659 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d7cce2e0-2bbf-465d-85e8-36314e835f65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:34.506189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d7cce2e0-2bbf-465d-85e8-36314e835f65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088382 May 12 09:43:34.506801 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 424/843] 10.222.0.60 () {60 vars in 1315 bytes} [Thu May 12 09:43:34 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:43:35.089733 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b08cb0f9-d5f9-4923-a91e-7918ef262155 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:35.090369 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b08cb0f9-d5f9-4923-a91e-7918ef262155 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:35.102485 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b08cb0f9-d5f9-4923-a91e-7918ef262155 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:35.103016 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b08cb0f9-d5f9-4923-a91e-7918ef262155 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:35.103907 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b08cb0f9-d5f9-4923-a91e-7918ef262155 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:35.104423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b08cb0f9-d5f9-4923-a91e-7918ef262155 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:35.584987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b08cb0f9-d5f9-4923-a91e-7918ef262155 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:35.592531 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b08cb0f9-d5f9-4923-a91e-7918ef262155 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.506716 May 12 09:43:35.593098 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 420/844] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:35 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:35.790614 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-db6d948d-6f88-421e-8dc6-b979d5116c90 req-af871a65-c83a-43ce-a4bf-ec849fa48768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18552b7d-9ecc-4182-b0fd-726899815dcf", "tag": "b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:35.798446 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-db6d948d-6f88-421e-8dc6-b979d5116c90 req-af871a65-c83a-43ce-a4bf-ec849fa48768 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:35.798914 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-db6d948d-6f88-421e-8dc6-b979d5116c90 req-af871a65-c83a-43ce-a4bf-ec849fa48768 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:35.810198 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-db6d948d-6f88-421e-8dc6-b979d5116c90 req-af871a65-c83a-43ce-a4bf-ec849fa48768 service nova] Creating event network-changed:b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b for instance 18552b7d-9ecc-4182-b0fd-726899815dcf on hv-cinder-83769 May 12 09:43:35.815450 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-db6d948d-6f88-421e-8dc6-b979d5116c90 req-af871a65-c83a-43ce-a4bf-ec849fa48768 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029083 May 12 09:43:35.816131 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 425/845] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:36.609991 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-75213f6f-a034-4710-b33b-3a05fa5e096b tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:36.610596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-75213f6f-a034-4710-b33b-3a05fa5e096b tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:36.617551 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-75213f6f-a034-4710-b33b-3a05fa5e096b tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:36.618027 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-75213f6f-a034-4710-b33b-3a05fa5e096b tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:36.618791 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-75213f6f-a034-4710-b33b-3a05fa5e096b tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:36.619219 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-75213f6f-a034-4710-b33b-3a05fa5e096b tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:36.763129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-75213f6f-a034-4710-b33b-3a05fa5e096b tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:36.771023 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-75213f6f-a034-4710-b33b-3a05fa5e096b tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.164755 May 12 09:43:36.771611 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 421/846] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:36 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:37.789871 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a47cefd1-efbf-41e7-9b1e-2a09ef9197f1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:37.790601 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a47cefd1-efbf-41e7-9b1e-2a09ef9197f1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:37.796689 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a47cefd1-efbf-41e7-9b1e-2a09ef9197f1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:37.797145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a47cefd1-efbf-41e7-9b1e-2a09ef9197f1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:37.797935 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a47cefd1-efbf-41e7-9b1e-2a09ef9197f1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:37.798384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a47cefd1-efbf-41e7-9b1e-2a09ef9197f1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:37.925725 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a47cefd1-efbf-41e7-9b1e-2a09ef9197f1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:37.933308 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a47cefd1-efbf-41e7-9b1e-2a09ef9197f1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.148101 May 12 09:43:37.933878 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 426/847] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:37 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:38.951601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0e698bb3-6cff-47c1-a582-34ce090e750e tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:38.952219 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0e698bb3-6cff-47c1-a582-34ce090e750e tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:38.959429 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e698bb3-6cff-47c1-a582-34ce090e750e tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:38.959881 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e698bb3-6cff-47c1-a582-34ce090e750e tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:38.960644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e698bb3-6cff-47c1-a582-34ce090e750e tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:38.961084 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0e698bb3-6cff-47c1-a582-34ce090e750e tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:39.089481 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0e698bb3-6cff-47c1-a582-34ce090e750e tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:39.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0e698bb3-6cff-47c1-a582-34ce090e750e tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.148929 May 12 09:43:39.097795 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 422/848] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:38 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:40.113842 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f9287c8d-1fe1-415f-a9d8-f3fbe97d5b1f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:40.114464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f9287c8d-1fe1-415f-a9d8-f3fbe97d5b1f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:40.120635 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f9287c8d-1fe1-415f-a9d8-f3fbe97d5b1f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:40.121089 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f9287c8d-1fe1-415f-a9d8-f3fbe97d5b1f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:40.121879 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f9287c8d-1fe1-415f-a9d8-f3fbe97d5b1f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:40.122352 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f9287c8d-1fe1-415f-a9d8-f3fbe97d5b1f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:40.252461 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f9287c8d-1fe1-415f-a9d8-f3fbe97d5b1f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:40.260198 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f9287c8d-1fe1-415f-a9d8-f3fbe97d5b1f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.150203 May 12 09:43:40.260781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 427/849] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:40 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:41.276375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-541cde61-83b4-4d1a-a9d9-c30694a4cbde tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:41.276989 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-541cde61-83b4-4d1a-a9d9-c30694a4cbde tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:41.283823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-541cde61-83b4-4d1a-a9d9-c30694a4cbde tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:41.284271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-541cde61-83b4-4d1a-a9d9-c30694a4cbde tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:41.285045 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-541cde61-83b4-4d1a-a9d9-c30694a4cbde tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:41.285481 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-541cde61-83b4-4d1a-a9d9-c30694a4cbde tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:41.410526 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-541cde61-83b4-4d1a-a9d9-c30694a4cbde tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:41.417724 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-541cde61-83b4-4d1a-a9d9-c30694a4cbde tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.145175 May 12 09:43:41.418329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 423/850] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:41 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:42.435470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8d1708ef-d19b-49fe-b3e4-feca703d5a89 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:42.436015 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8d1708ef-d19b-49fe-b3e4-feca703d5a89 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:42.442822 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8d1708ef-d19b-49fe-b3e4-feca703d5a89 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:42.443269 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8d1708ef-d19b-49fe-b3e4-feca703d5a89 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:42.444023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8d1708ef-d19b-49fe-b3e4-feca703d5a89 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:42.444461 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8d1708ef-d19b-49fe-b3e4-feca703d5a89 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:42.572853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8d1708ef-d19b-49fe-b3e4-feca703d5a89 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:42.580132 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8d1708ef-d19b-49fe-b3e4-feca703d5a89 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.148624 May 12 09:43:42.580693 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 428/851] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:42 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:43.597311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5afeede2-d248-44ab-baaa-5607b4cd5278 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:43.597951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5afeede2-d248-44ab-baaa-5607b4cd5278 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:43.604440 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5afeede2-d248-44ab-baaa-5607b4cd5278 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:43.604881 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5afeede2-d248-44ab-baaa-5607b4cd5278 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:43.605641 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5afeede2-d248-44ab-baaa-5607b4cd5278 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:43.606110 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5afeede2-d248-44ab-baaa-5607b4cd5278 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:43.739668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5afeede2-d248-44ab-baaa-5607b4cd5278 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:43.747197 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5afeede2-d248-44ab-baaa-5607b4cd5278 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.153785 May 12 09:43:43.747788 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 424/852] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:43 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:44.765393 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-fc573da3-9ed4-4791-b1e8-c79d00e0504d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:44.766025 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-fc573da3-9ed4-4791-b1e8-c79d00e0504d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:44.772783 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fc573da3-9ed4-4791-b1e8-c79d00e0504d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:44.773229 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fc573da3-9ed4-4791-b1e8-c79d00e0504d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:44.774013 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fc573da3-9ed4-4791-b1e8-c79d00e0504d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:44.774452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fc573da3-9ed4-4791-b1e8-c79d00e0504d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:44.903563 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-fc573da3-9ed4-4791-b1e8-c79d00e0504d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:44.911446 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-fc573da3-9ed4-4791-b1e8-c79d00e0504d tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.149930 May 12 09:43:44.912000 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 429/853] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:44 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:45.929888 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c7bf4904-2f66-4354-a7e0-a052e495e895 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:45.930559 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c7bf4904-2f66-4354-a7e0-a052e495e895 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:45.936499 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c7bf4904-2f66-4354-a7e0-a052e495e895 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:45.936947 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c7bf4904-2f66-4354-a7e0-a052e495e895 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:45.937715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c7bf4904-2f66-4354-a7e0-a052e495e895 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:45.938178 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c7bf4904-2f66-4354-a7e0-a052e495e895 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:46.123270 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c7bf4904-2f66-4354-a7e0-a052e495e895 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:46.131073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c7bf4904-2f66-4354-a7e0-a052e495e895 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.205070 May 12 09:43:46.131640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 425/854] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:45 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:47.149207 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-298685db-afac-42e8-a43f-940f5ad39539 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:47.149792 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-298685db-afac-42e8-a43f-940f5ad39539 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:47.156227 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-298685db-afac-42e8-a43f-940f5ad39539 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:47.156672 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-298685db-afac-42e8-a43f-940f5ad39539 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:47.157426 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-298685db-afac-42e8-a43f-940f5ad39539 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:47.157916 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-298685db-afac-42e8-a43f-940f5ad39539 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:47.284136 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-298685db-afac-42e8-a43f-940f5ad39539 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:47.291400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-298685db-afac-42e8-a43f-940f5ad39539 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.146242 May 12 09:43:47.292019 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 430/855] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:47 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:48.308619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0b00ba45-ce6e-443c-9118-c31d579326cf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:48.309225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0b00ba45-ce6e-443c-9118-c31d579326cf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:48.315466 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0b00ba45-ce6e-443c-9118-c31d579326cf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:48.315917 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0b00ba45-ce6e-443c-9118-c31d579326cf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:48.316702 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0b00ba45-ce6e-443c-9118-c31d579326cf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:48.317123 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0b00ba45-ce6e-443c-9118-c31d579326cf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:48.448535 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0b00ba45-ce6e-443c-9118-c31d579326cf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:48.456383 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0b00ba45-ce6e-443c-9118-c31d579326cf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.151709 May 12 09:43:48.456949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 426/856] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:48 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:49.473801 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-90d4be6e-9b60-44c5-a9d1-058723052c25 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:49.474411 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-90d4be6e-9b60-44c5-a9d1-058723052c25 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:49.480670 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90d4be6e-9b60-44c5-a9d1-058723052c25 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:49.481111 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90d4be6e-9b60-44c5-a9d1-058723052c25 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:49.481868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90d4be6e-9b60-44c5-a9d1-058723052c25 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:49.482321 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90d4be6e-9b60-44c5-a9d1-058723052c25 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:49.616081 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-90d4be6e-9b60-44c5-a9d1-058723052c25 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:49.623563 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-90d4be6e-9b60-44c5-a9d1-058723052c25 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1509 microversion: 2.1 time: 0.154063 May 12 09:43:49.624084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 431/857] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:49 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:49.639972 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-80495253-05e5-4582-a110-0377d57728e9 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:49.640619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-80495253-05e5-4582-a110-0377d57728e9 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:49.646970 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80495253-05e5-4582-a110-0377d57728e9 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:49.647418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80495253-05e5-4582-a110-0377d57728e9 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:49.648175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80495253-05e5-4582-a110-0377d57728e9 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:49.648608 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80495253-05e5-4582-a110-0377d57728e9 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:49.734245 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-80495253-05e5-4582-a110-0377d57728e9 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "POST /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f/action" status: 202 len: 0 microversion: 2.1 time: 0.097897 May 12 09:43:49.734775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 427/858] 10.222.0.60 () {60 vars in 1277 bytes} [Thu May 12 09:43:49 2022] POST /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:43:49.744156 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f65f321d-6288-4180-b00b-fa4373ba1faf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:49.744769 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f65f321d-6288-4180-b00b-fa4373ba1faf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:49.752275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f65f321d-6288-4180-b00b-fa4373ba1faf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:49.752729 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f65f321d-6288-4180-b00b-fa4373ba1faf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:49.753510 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f65f321d-6288-4180-b00b-fa4373ba1faf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:49.753976 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f65f321d-6288-4180-b00b-fa4373ba1faf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:49.909347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f65f321d-6288-4180-b00b-fa4373ba1faf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:49.921284 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f65f321d-6288-4180-b00b-fa4373ba1faf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1517 microversion: 2.1 time: 0.181351 May 12 09:43:49.922015 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 432/859] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:49 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:43:50.939097 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-bb240fe0-7b21-41a9-87b6-d7d40eb04201 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:50.939655 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-bb240fe0-7b21-41a9-87b6-d7d40eb04201 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:50.945924 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bb240fe0-7b21-41a9-87b6-d7d40eb04201 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:50.946390 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bb240fe0-7b21-41a9-87b6-d7d40eb04201 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:50.947159 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bb240fe0-7b21-41a9-87b6-d7d40eb04201 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:50.947600 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bb240fe0-7b21-41a9-87b6-d7d40eb04201 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:51.081632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-bb240fe0-7b21-41a9-87b6-d7d40eb04201 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:51.089277 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-bb240fe0-7b21-41a9-87b6-d7d40eb04201 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1519 microversion: 2.1 time: 0.154048 May 12 09:43:51.090039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 428/860] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:50 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:51.762927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-064ac2df-8071-46c1-9907-f691c1516d18 req-686df51b-82e2-4b4f-9450-91f90339dd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5697f44b-088d-48ee-89a1-ae6d09f7d47f", "name": "network-vif-unplugged", "status": "completed", "tag": "24fe4aa4-21d7-4953-acd5-384b86945694"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:51.772426 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-064ac2df-8071-46c1-9907-f691c1516d18 req-686df51b-82e2-4b4f-9450-91f90339dd51 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:51.772962 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-064ac2df-8071-46c1-9907-f691c1516d18 req-686df51b-82e2-4b4f-9450-91f90339dd51 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:51.785641 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-064ac2df-8071-46c1-9907-f691c1516d18 req-686df51b-82e2-4b4f-9450-91f90339dd51 service nova] Creating event network-vif-unplugged:24fe4aa4-21d7-4953-acd5-384b86945694 for instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f on hv-cinder-83769 May 12 09:43:51.790731 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-064ac2df-8071-46c1-9907-f691c1516d18 req-686df51b-82e2-4b4f-9450-91f90339dd51 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031782 May 12 09:43:51.791389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 433/861] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:52.107789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1e9a46ef-9a97-4cf1-bb2b-475f6a545460 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:52.108396 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1e9a46ef-9a97-4cf1-bb2b-475f6a545460 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:52.115248 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1e9a46ef-9a97-4cf1-bb2b-475f6a545460 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:52.115695 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1e9a46ef-9a97-4cf1-bb2b-475f6a545460 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:52.116456 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1e9a46ef-9a97-4cf1-bb2b-475f6a545460 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:52.116886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1e9a46ef-9a97-4cf1-bb2b-475f6a545460 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:52.306072 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1e9a46ef-9a97-4cf1-bb2b-475f6a545460 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:52.313498 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1e9a46ef-9a97-4cf1-bb2b-475f6a545460 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.209593 May 12 09:43:52.314118 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 429/862] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:52 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:53.089833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6b43aabe-077b-48b8-9bb6-2da24af3449d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:53.090422 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6b43aabe-077b-48b8-9bb6-2da24af3449d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:53.098961 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6b43aabe-077b-48b8-9bb6-2da24af3449d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:53.098961 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6b43aabe-077b-48b8-9bb6-2da24af3449d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:53.098961 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6b43aabe-077b-48b8-9bb6-2da24af3449d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:53.098961 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6b43aabe-077b-48b8-9bb6-2da24af3449d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:53.122505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6b43aabe-077b-48b8-9bb6-2da24af3449d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/ips" status: 200 len: 150 microversion: 2.1 time: 0.037288 May 12 09:43:53.123062 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 434/863] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:43:53 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:53.332437 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-89b57440-ed21-4835-9851-f968d3da7450 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:53.333308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-89b57440-ed21-4835-9851-f968d3da7450 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:53.340228 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-89b57440-ed21-4835-9851-f968d3da7450 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:53.340228 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-89b57440-ed21-4835-9851-f968d3da7450 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:53.341017 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-89b57440-ed21-4835-9851-f968d3da7450 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:53.341511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-89b57440-ed21-4835-9851-f968d3da7450 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:53.473654 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-89b57440-ed21-4835-9851-f968d3da7450 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:53.480944 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-89b57440-ed21-4835-9851-f968d3da7450 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.152990 May 12 09:43:53.481504 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 430/864] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:53 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:54.438254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0c11c9be-3341-4613-b4bb-dd10c2da8a26 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4599d052-81c7-4068-8ecb-082b5dd3e276"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:43:54.439884 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0c11c9be-3341-4613-b4bb-dd10c2da8a26 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:54.446177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c11c9be-3341-4613-b4bb-dd10c2da8a26 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:54.446635 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c11c9be-3341-4613-b4bb-dd10c2da8a26 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:54.447401 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c11c9be-3341-4613-b4bb-dd10c2da8a26 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:54.447843 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c11c9be-3341-4613-b4bb-dd10c2da8a26 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:54.498640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c36f02dd-ba79-4494-8bf0-3ae90482ece1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:54.499320 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c36f02dd-ba79-4494-8bf0-3ae90482ece1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:54.507845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c36f02dd-ba79-4494-8bf0-3ae90482ece1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:54.508648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c36f02dd-ba79-4494-8bf0-3ae90482ece1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:54.509512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c36f02dd-ba79-4494-8bf0-3ae90482ece1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:54.510038 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c36f02dd-ba79-4494-8bf0-3ae90482ece1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:54.647445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c36f02dd-ba79-4494-8bf0-3ae90482ece1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:54.655206 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c36f02dd-ba79-4494-8bf0-3ae90482ece1 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.160442 May 12 09:43:54.655773 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 431/865] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:54 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:43:54.710139 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-0c11c9be-3341-4613-b4bb-dd10c2da8a26 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275660 May 12 09:43:54.710736 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 435/866] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:43:54 2022] POST /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:43:55.672790 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1ad8eaf7-67ee-4e94-ab8c-cd5cf96c9462 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:55.673351 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1ad8eaf7-67ee-4e94-ab8c-cd5cf96c9462 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:55.679550 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ad8eaf7-67ee-4e94-ab8c-cd5cf96c9462 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:55.679990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ad8eaf7-67ee-4e94-ab8c-cd5cf96c9462 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:55.680739 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ad8eaf7-67ee-4e94-ab8c-cd5cf96c9462 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:55.681167 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ad8eaf7-67ee-4e94-ab8c-cd5cf96c9462 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:55.812016 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1ad8eaf7-67ee-4e94-ab8c-cd5cf96c9462 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:55.819799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1ad8eaf7-67ee-4e94-ab8c-cd5cf96c9462 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.150996 May 12 09:43:55.820352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 432/867] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:55 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:56.837943 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b12319cf-79bf-4470-a367-b121d2ce9260 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:56.838866 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b12319cf-79bf-4470-a367-b121d2ce9260 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:56.844967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b12319cf-79bf-4470-a367-b121d2ce9260 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:56.846079 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b12319cf-79bf-4470-a367-b121d2ce9260 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:56.846929 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b12319cf-79bf-4470-a367-b121d2ce9260 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:56.847373 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b12319cf-79bf-4470-a367-b121d2ce9260 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:56.983274 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b12319cf-79bf-4470-a367-b121d2ce9260 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:56.990596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b12319cf-79bf-4470-a367-b121d2ce9260 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.157473 May 12 09:43:56.991155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 436/868] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:56 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:58.007863 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-66eb6d2b-c612-4675-83d0-4dbf892aefbe tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:58.008714 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-66eb6d2b-c612-4675-83d0-4dbf892aefbe tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:58.014930 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66eb6d2b-c612-4675-83d0-4dbf892aefbe tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:58.015371 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66eb6d2b-c612-4675-83d0-4dbf892aefbe tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:58.016116 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66eb6d2b-c612-4675-83d0-4dbf892aefbe tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:58.016542 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-66eb6d2b-c612-4675-83d0-4dbf892aefbe tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:58.140878 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-66eb6d2b-c612-4675-83d0-4dbf892aefbe tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:58.148676 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-66eb6d2b-c612-4675-83d0-4dbf892aefbe tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.144658 May 12 09:43:58.149235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 433/869] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:58 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:43:59.165123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4d0565dc-44b4-40eb-b56e-9c84c7b6d844 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:43:59.165733 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4d0565dc-44b4-40eb-b56e-9c84c7b6d844 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:43:59.172052 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4d0565dc-44b4-40eb-b56e-9c84c7b6d844 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:59.172506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4d0565dc-44b4-40eb-b56e-9c84c7b6d844 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:59.173337 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4d0565dc-44b4-40eb-b56e-9c84c7b6d844 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:43:59.173723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4d0565dc-44b4-40eb-b56e-9c84c7b6d844 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:43:59.301319 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4d0565dc-44b4-40eb-b56e-9c84c7b6d844 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:43:59.308565 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4d0565dc-44b4-40eb-b56e-9c84c7b6d844 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.147337 May 12 09:43:59.309115 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 437/870] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:43:59 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:00.325687 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5a3886cb-fc0d-48a9-9503-07e677bb5089 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:00.326316 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5a3886cb-fc0d-48a9-9503-07e677bb5089 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:00.333073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5a3886cb-fc0d-48a9-9503-07e677bb5089 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:00.333527 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5a3886cb-fc0d-48a9-9503-07e677bb5089 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:00.334324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5a3886cb-fc0d-48a9-9503-07e677bb5089 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:00.334808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5a3886cb-fc0d-48a9-9503-07e677bb5089 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:00.499485 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5a3886cb-fc0d-48a9-9503-07e677bb5089 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:00.506712 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5a3886cb-fc0d-48a9-9503-07e677bb5089 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.185028 May 12 09:44:00.507279 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 434/871] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:00 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:01.524370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c556ddd0-4aca-4f23-bf82-74b551a9fbcb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:01.524979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c556ddd0-4aca-4f23-bf82-74b551a9fbcb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:01.531280 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c556ddd0-4aca-4f23-bf82-74b551a9fbcb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:01.531731 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c556ddd0-4aca-4f23-bf82-74b551a9fbcb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:01.532492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c556ddd0-4aca-4f23-bf82-74b551a9fbcb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:01.533519 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c556ddd0-4aca-4f23-bf82-74b551a9fbcb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:01.729603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c556ddd0-4aca-4f23-bf82-74b551a9fbcb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:01.737053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c556ddd0-4aca-4f23-bf82-74b551a9fbcb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.216477 May 12 09:44:01.737611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 438/872] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:01 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:02.755039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2b80c0d7-290b-49c4-9958-1fe863ef2abf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:02.755643 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2b80c0d7-290b-49c4-9958-1fe863ef2abf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:02.762156 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b80c0d7-290b-49c4-9958-1fe863ef2abf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:02.762602 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b80c0d7-290b-49c4-9958-1fe863ef2abf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:02.763359 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b80c0d7-290b-49c4-9958-1fe863ef2abf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:02.764466 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b80c0d7-290b-49c4-9958-1fe863ef2abf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:02.891873 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2b80c0d7-290b-49c4-9958-1fe863ef2abf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:02.899659 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2b80c0d7-290b-49c4-9958-1fe863ef2abf tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1575 microversion: 2.1 time: 0.149694 May 12 09:44:02.900221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 435/873] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:02 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:03.236705 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4599d052-81c7-4068-8ecb-082b5dd3e276"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:03.237819 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:03.244245 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:03.244688 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:03.245439 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:03.245868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:03.323600 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Invalid volume: volume 4599d052-81c7-4068-8ecb-082b5dd3e276 is already attached to instances: c8d69574-dc82-4b58-a777-9618741b0e9c May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: POST /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments HTTP/1.1 May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 74 May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:44:03.325301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {"volumeAttachment": {"volumeId": "4599d052-81c7-4068-8ecb-082b5dd3e276"}} May 12 09:44:03.326967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Invalid volume: volume 4599d052-81c7-4068-8ecb-082b5dd3e276 is already attached to instances: c8d69574-dc82-4b58-a777-9618741b0e9c May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'server_id': 'c8d69574-dc82-4b58-a777-9618741b0e9c', 'body': {'volumeAttachment': {'volumeId': '4599d052-81c7-4068-8ecb-082b5dd3e276'}}} May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4599d052-81c7-4068-8ecb-082b5dd3e276 is already attached to instances: c8d69574-dc82-4b58-a777-9618741b0e9c May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:44:03.327898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4599d052-81c7-4068-8ecb-082b5dd3e276 is already attached to instances: c8d69574-dc82-4b58-a777-9618741b0e9c May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:44:03.329344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:44:03.330923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:44:03.330923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:44:03.330923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:44:03.330923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4599d052-81c7-4068-8ecb-082b5dd3e276 is already attached to instances: c8d69574-dc82-4b58-a777-9618741b0e9c May 12 09:44:03.330923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:44:03.330923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 400 to user: Invalid volume: volume 4599d052-81c7-4068-8ecb-082b5dd3e276 is already attached to instances: c8d69574-dc82-4b58-a777-9618741b0e9c {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:44:03.330923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-271aad88-e7b4-41c7-83c9-d14bef2e44fb tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094216 May 12 09:44:03.330923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 439/874] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:44:03 2022] POST /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 09:44:03.385824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ec5e613e-a676-4762-bb6a-60f2842c4108 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:03.386343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ec5e613e-a676-4762-bb6a-60f2842c4108 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:03.392067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ec5e613e-a676-4762-bb6a-60f2842c4108 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:03.392543 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ec5e613e-a676-4762-bb6a-60f2842c4108 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:03.393290 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ec5e613e-a676-4762-bb6a-60f2842c4108 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:03.393721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ec5e613e-a676-4762-bb6a-60f2842c4108 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:03.469975 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-ec5e613e-a676-4762-bb6a-60f2842c4108 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lazy-loading 'services' on Instance uuid c8d69574-dc82-4b58-a777-9618741b0e9c {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:44:03.539088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ec5e613e-a676-4762-bb6a-60f2842c4108 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments/4599d052-81c7-4068-8ecb-082b5dd3e276" status: 202 len: 0 microversion: 2.1 time: 0.157197 May 12 09:44:03.539659 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 436/875] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:44:03 2022] DELETE /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments/4599d052-81c7-4068-8ecb-082b5dd3e276 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:44:03.547787 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-fb63c507-6eba-41b3-a19f-cdcf8c23b4e2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:03.548736 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-fb63c507-6eba-41b3-a19f-cdcf8c23b4e2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:03.555244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fb63c507-6eba-41b3-a19f-cdcf8c23b4e2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:03.555687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fb63c507-6eba-41b3-a19f-cdcf8c23b4e2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:03.556442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fb63c507-6eba-41b3-a19f-cdcf8c23b4e2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:03.556878 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-fb63c507-6eba-41b3-a19f-cdcf8c23b4e2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:03.584569 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-fb63c507-6eba-41b3-a19f-cdcf8c23b4e2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040651 May 12 09:44:03.585103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 440/876] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:44:03 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:03.917132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ee5ad0ad-c391-4241-8337-b20d87a5d64f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:03.917832 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ee5ad0ad-c391-4241-8337-b20d87a5d64f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:03.925854 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ee5ad0ad-c391-4241-8337-b20d87a5d64f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:03.926421 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ee5ad0ad-c391-4241-8337-b20d87a5d64f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:03.927290 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ee5ad0ad-c391-4241-8337-b20d87a5d64f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:03.927991 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ee5ad0ad-c391-4241-8337-b20d87a5d64f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:03.958641 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-8b367f13-251e-4b12-a8d7-08ad11487022 req-ad560fed-ef6b-40d6-a6db-c376a7e28af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5697f44b-088d-48ee-89a1-ae6d09f7d47f", "name": "network-vif-plugged", "status": "completed", "tag": "24fe4aa4-21d7-4953-acd5-384b86945694"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:03.971917 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-8b367f13-251e-4b12-a8d7-08ad11487022 req-ad560fed-ef6b-40d6-a6db-c376a7e28af7 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:03.979242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-8b367f13-251e-4b12-a8d7-08ad11487022 req-ad560fed-ef6b-40d6-a6db-c376a7e28af7 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:03.993589 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-8b367f13-251e-4b12-a8d7-08ad11487022 req-ad560fed-ef6b-40d6-a6db-c376a7e28af7 service nova] Creating event network-vif-plugged:24fe4aa4-21d7-4953-acd5-384b86945694 for instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f on hv-cinder-83769 May 12 09:44:04.000243 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-8b367f13-251e-4b12-a8d7-08ad11487022 req-ad560fed-ef6b-40d6-a6db-c376a7e28af7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044796 May 12 09:44:04.002103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 441/877] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:04.069318 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ee5ad0ad-c391-4241-8337-b20d87a5d64f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:04.076733 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ee5ad0ad-c391-4241-8337-b20d87a5d64f tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1562 microversion: 2.1 time: 0.163832 May 12 09:44:04.077303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 437/878] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:03 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:04.597874 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6f7e8bc9-c45a-498c-9e6c-642fe12f6102 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:04.598903 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6f7e8bc9-c45a-498c-9e6c-642fe12f6102 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:04.604895 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f7e8bc9-c45a-498c-9e6c-642fe12f6102 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:04.605349 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f7e8bc9-c45a-498c-9e6c-642fe12f6102 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:04.606149 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f7e8bc9-c45a-498c-9e6c-642fe12f6102 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:04.606593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f7e8bc9-c45a-498c-9e6c-642fe12f6102 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:04.635287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6f7e8bc9-c45a-498c-9e6c-642fe12f6102 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042603 May 12 09:44:04.635820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 442/879] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:44:04 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:05.647240 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-13961188-5cdc-4d84-bb5e-1bcdb247440b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:05.648527 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-13961188-5cdc-4d84-bb5e-1bcdb247440b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:05.655253 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-13961188-5cdc-4d84-bb5e-1bcdb247440b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:05.655698 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-13961188-5cdc-4d84-bb5e-1bcdb247440b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:05.656455 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-13961188-5cdc-4d84-bb5e-1bcdb247440b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:05.656886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-13961188-5cdc-4d84-bb5e-1bcdb247440b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:05.684996 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-13961188-5cdc-4d84-bb5e-1bcdb247440b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043133 May 12 09:44:05.685541 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 438/880] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:44:05 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 09:44:05.741072 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0c896459-6bda-4e87-88f1-9e07109ecc72 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:05.741601 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0c896459-6bda-4e87-88f1-9e07109ecc72 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:05.747784 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c896459-6bda-4e87-88f1-9e07109ecc72 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:05.748252 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c896459-6bda-4e87-88f1-9e07109ecc72 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:05.749059 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c896459-6bda-4e87-88f1-9e07109ecc72 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:05.749440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0c896459-6bda-4e87-88f1-9e07109ecc72 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:05.774071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0c896459-6bda-4e87-88f1-9e07109ecc72 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:44:05.845269 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-0c896459-6bda-4e87-88f1-9e07109ecc72 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 204 len: 0 microversion: 2.1 time: 0.108633 May 12 09:44:05.846029 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 443/881] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:44:05 2022] DELETE /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:44:05.855175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-510990e8-149f-4cee-a816-3e4cf7bec2cc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:05.855890 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-510990e8-149f-4cee-a816-3e4cf7bec2cc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:05.862374 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-510990e8-149f-4cee-a816-3e4cf7bec2cc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:05.862821 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-510990e8-149f-4cee-a816-3e4cf7bec2cc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:05.863577 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-510990e8-149f-4cee-a816-3e4cf7bec2cc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:05.864012 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-510990e8-149f-4cee-a816-3e4cf7bec2cc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:05.991135 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-510990e8-149f-4cee-a816-3e4cf7bec2cc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:05.998345 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-510990e8-149f-4cee-a816-3e4cf7bec2cc tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1682 microversion: 2.1 time: 0.147664 May 12 09:44:05.998903 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 439/882] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:05 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:07.016399 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4e55d64f-a9e3-464a-9c08-e4699a453213 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:07.017092 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4e55d64f-a9e3-464a-9c08-e4699a453213 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:07.023918 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e55d64f-a9e3-464a-9c08-e4699a453213 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:07.024359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e55d64f-a9e3-464a-9c08-e4699a453213 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:07.025111 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e55d64f-a9e3-464a-9c08-e4699a453213 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:07.025571 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4e55d64f-a9e3-464a-9c08-e4699a453213 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:07.150116 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4e55d64f-a9e3-464a-9c08-e4699a453213 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:07.157369 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4e55d64f-a9e3-464a-9c08-e4699a453213 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1682 microversion: 2.1 time: 0.145193 May 12 09:44:07.157948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 444/883] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:07 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:08.174723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-396b68c1-b7b5-433c-8049-cbdf29568b8a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:08.175371 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-396b68c1-b7b5-433c-8049-cbdf29568b8a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:08.181653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-396b68c1-b7b5-433c-8049-cbdf29568b8a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:08.182144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-396b68c1-b7b5-433c-8049-cbdf29568b8a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:08.182907 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-396b68c1-b7b5-433c-8049-cbdf29568b8a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:08.183343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-396b68c1-b7b5-433c-8049-cbdf29568b8a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:08.399425 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-396b68c1-b7b5-433c-8049-cbdf29568b8a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:08.406705 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-396b68c1-b7b5-433c-8049-cbdf29568b8a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 200 len: 1682 microversion: 2.1 time: 0.236406 May 12 09:44:08.407272 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 440/884] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:08 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:08.793965 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-0165b27c-0c8e-48a6-80db-2ac67c13e689 req-25228e1a-b51b-49a8-afc4-1dac9f4204f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8d69574-dc82-4b58-a777-9618741b0e9c", "name": "network-vif-deleted", "tag": "ec3b1faa-64e6-47cb-8540-2a02a8bf548c"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:08.804776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-0165b27c-0c8e-48a6-80db-2ac67c13e689 req-25228e1a-b51b-49a8-afc4-1dac9f4204f9 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:08.805365 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-0165b27c-0c8e-48a6-80db-2ac67c13e689 req-25228e1a-b51b-49a8-afc4-1dac9f4204f9 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:08.817625 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-0165b27c-0c8e-48a6-80db-2ac67c13e689 req-25228e1a-b51b-49a8-afc4-1dac9f4204f9 service nova] Creating event network-vif-deleted:ec3b1faa-64e6-47cb-8540-2a02a8bf548c for instance c8d69574-dc82-4b58-a777-9618741b0e9c on hv-cinder-83769 May 12 09:44:08.823394 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-0165b27c-0c8e-48a6-80db-2ac67c13e689 req-25228e1a-b51b-49a8-afc4-1dac9f4204f9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 May 12 09:44:08.824254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 445/885] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:09.424795 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:09.426129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:09.433073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:09.433535 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:09.434421 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:09.434900 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:09.449636 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c HTTP/1.1 May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:44:09.451606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:44:09.453006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'c8d69574-dc82-4b58-a777-9618741b0e9c'} May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:44:09.453824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:44:09.455723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:44:09.456919 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:44:09.456919 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4990422e-22a2-43b3-9e03-19da2d0071a0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 404 len: 111 microversion: 2.1 time: 0.032725 May 12 09:44:09.456919 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 441/886] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:09 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:44:09.462958 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6c5edffd-a7b5-4e8a-b54e-68195d0b020d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '.version_select at 0x7f87256e3700>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:09.482672 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6c5edffd-a7b5-4e8a-b54e-68195d0b020d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209451788" status: 202 len: 0 microversion: 2.1 time: 0.023794 May 12 09:44:09.483265 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 446/887] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 12 09:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209451788 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 09:44:10.100211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d0cf0f45-df13-4496-9be5-1ef50aa65a64 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: .version_select at 0x7f8725fb9a60>, body: {"keypair": {"name": "tempest-keypair-1673733912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn0EEOai7XupW1mbmbZlt6yHjpfH1MCcHfNXL7/1/Q0DulKgb5mQnCicthGCPTgJCOy5Hc38dwuCbSCU/S38cKJ1fURncXiyxVNp0SoSZ0twzo9Xx4oNu7bWdnMGQRxGw=="}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:10.113553 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-d0cf0f45-df13-4496-9be5-1ef50aa65a64 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:44:10.117181 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-d0cf0f45-df13-4496-9be5-1ef50aa65a64 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for user 6c8297034cfa40438000e7d94419a429 and project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:44:10.137653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d0cf0f45-df13-4496-9be5-1ef50aa65a64 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042726 May 12 09:44:10.138263 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 442/888] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:44:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:11.679617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-975866288", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8bd03ea-0f3b-46bf-82a8-531c929bec57"}], "security_groups": [{"name": "tempest-securitygroup--244337414"}], "key_name": "tempest-keypair-1673733912", "user_data": "}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:11.779100 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] validate_networks() for [('d8bd03ea-0f3b-46bf-82a8-531c929bec57', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:44:12.144802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:44:12.145225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:44:12.145795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:44:12.146225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:44:12.146636 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:44:12.155243 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:12.155690 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:12.156484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:12.156922 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:12.173222 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:44:12.177618 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Getting quotas for user 6c8297034cfa40438000e7d94419a429 and project b079fd0b329c4f1a856f71e0c8f98dde. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:44:12.188106 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:44:12.190411 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:44:12.238546 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2e018cc8-3d6b-4de1-a215-96f984211453 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.563234 May 12 09:44:12.239177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 447/889] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:44:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:44:12.249688 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6cfd1e1d-c346-4a69-9f4a-8c8c5c0f0ee7 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:12.250357 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6cfd1e1d-c346-4a69-9f4a-8c8c5c0f0ee7 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:12.355957 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6cfd1e1d-c346-4a69-9f4a-8c8c5c0f0ee7 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:12.363595 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6cfd1e1d-c346-4a69-9f4a-8c8c5c0f0ee7 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1241 microversion: 2.1 time: 0.118130 May 12 09:44:12.364156 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 443/890] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:12 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:13.381492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1a38b2b8-a221-4f50-82cb-06681bdd2830 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:13.382128 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1a38b2b8-a221-4f50-82cb-06681bdd2830 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:13.388979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1a38b2b8-a221-4f50-82cb-06681bdd2830 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:13.389425 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1a38b2b8-a221-4f50-82cb-06681bdd2830 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:13.390212 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1a38b2b8-a221-4f50-82cb-06681bdd2830 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:13.390643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1a38b2b8-a221-4f50-82cb-06681bdd2830 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:13.468774 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1a38b2b8-a221-4f50-82cb-06681bdd2830 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:13.476770 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1a38b2b8-a221-4f50-82cb-06681bdd2830 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1311 microversion: 2.1 time: 0.099877 May 12 09:44:13.477330 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 448/891] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:13 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:44:14.493884 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-cb24ecaa-b80c-4fbf-8db4-52758caf6f5b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:14.494617 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-cb24ecaa-b80c-4fbf-8db4-52758caf6f5b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:14.500911 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cb24ecaa-b80c-4fbf-8db4-52758caf6f5b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:14.501425 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cb24ecaa-b80c-4fbf-8db4-52758caf6f5b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:14.502257 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cb24ecaa-b80c-4fbf-8db4-52758caf6f5b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:14.502690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cb24ecaa-b80c-4fbf-8db4-52758caf6f5b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:14.719132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cb24ecaa-b80c-4fbf-8db4-52758caf6f5b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:14.727972 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-cb24ecaa-b80c-4fbf-8db4-52758caf6f5b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1366 microversion: 2.1 time: 0.237850 May 12 09:44:14.728640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 444/892] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:14 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:14.916696 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-f3224f14-cc10-41e7-a876-be78b67dada8 req-d4b3a085-12d9-4f5d-80f3-3078314e8126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe60f94-7d27-4924-8df7-0a49d9455ade", "tag": "5fd0072b-c35b-4eb8-95e5-e20e592d7b49"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:14.928451 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f3224f14-cc10-41e7-a876-be78b67dada8 req-d4b3a085-12d9-4f5d-80f3-3078314e8126 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:14.929753 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f3224f14-cc10-41e7-a876-be78b67dada8 req-d4b3a085-12d9-4f5d-80f3-3078314e8126 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:14.945557 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-f3224f14-cc10-41e7-a876-be78b67dada8 req-d4b3a085-12d9-4f5d-80f3-3078314e8126 service nova] Creating event network-changed:5fd0072b-c35b-4eb8-95e5-e20e592d7b49 for instance afe60f94-7d27-4924-8df7-0a49d9455ade on hv-cinder-83769 May 12 09:44:14.952292 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-f3224f14-cc10-41e7-a876-be78b67dada8 req-d4b3a085-12d9-4f5d-80f3-3078314e8126 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040431 May 12 09:44:14.953146 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 449/893] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:15.746779 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-08874334-b68d-48fd-9c99-aa118afe1546 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:15.747386 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-08874334-b68d-48fd-9c99-aa118afe1546 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:15.754709 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-08874334-b68d-48fd-9c99-aa118afe1546 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:15.755149 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-08874334-b68d-48fd-9c99-aa118afe1546 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:15.755907 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-08874334-b68d-48fd-9c99-aa118afe1546 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:15.756340 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-08874334-b68d-48fd-9c99-aa118afe1546 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:15.885662 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-08874334-b68d-48fd-9c99-aa118afe1546 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:15.893356 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-08874334-b68d-48fd-9c99-aa118afe1546 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1366 microversion: 2.1 time: 0.150736 May 12 09:44:15.893938 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 445/894] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:15 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:44:16.911077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-483a17ec-7a9b-41dd-8b61-2960cd89757c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:16.911772 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-483a17ec-7a9b-41dd-8b61-2960cd89757c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:16.918291 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-483a17ec-7a9b-41dd-8b61-2960cd89757c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:16.918743 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-483a17ec-7a9b-41dd-8b61-2960cd89757c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:16.919509 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-483a17ec-7a9b-41dd-8b61-2960cd89757c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:16.919946 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-483a17ec-7a9b-41dd-8b61-2960cd89757c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:17.043331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-483a17ec-7a9b-41dd-8b61-2960cd89757c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:17.050546 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-483a17ec-7a9b-41dd-8b61-2960cd89757c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1366 microversion: 2.1 time: 0.144330 May 12 09:44:17.051140 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 450/895] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:16 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:18.067636 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-82a7a883-bcdb-4977-bdde-37266c5e9b08 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:18.068268 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-82a7a883-bcdb-4977-bdde-37266c5e9b08 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:18.074464 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-82a7a883-bcdb-4977-bdde-37266c5e9b08 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:18.074920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-82a7a883-bcdb-4977-bdde-37266c5e9b08 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:18.075684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-82a7a883-bcdb-4977-bdde-37266c5e9b08 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:18.076118 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-82a7a883-bcdb-4977-bdde-37266c5e9b08 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:18.302307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-82a7a883-bcdb-4977-bdde-37266c5e9b08 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:18.309721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-82a7a883-bcdb-4977-bdde-37266c5e9b08 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1366 microversion: 2.1 time: 0.246361 May 12 09:44:18.310565 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 446/896] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:18 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:19.327023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-257673b2-2340-49af-8bc0-0be53f1ab44b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:19.327653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-257673b2-2340-49af-8bc0-0be53f1ab44b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:19.333988 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-257673b2-2340-49af-8bc0-0be53f1ab44b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:19.334432 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-257673b2-2340-49af-8bc0-0be53f1ab44b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:19.335184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-257673b2-2340-49af-8bc0-0be53f1ab44b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:19.335646 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-257673b2-2340-49af-8bc0-0be53f1ab44b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:19.464088 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-257673b2-2340-49af-8bc0-0be53f1ab44b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:19.471677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-257673b2-2340-49af-8bc0-0be53f1ab44b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1366 microversion: 2.1 time: 0.148551 May 12 09:44:19.472226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 451/897] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:19 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:20.490186 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4894d4bf-ef27-4f6d-968c-4382b7f4fc30 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:20.491020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4894d4bf-ef27-4f6d-968c-4382b7f4fc30 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:20.497078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4894d4bf-ef27-4f6d-968c-4382b7f4fc30 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:20.497519 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4894d4bf-ef27-4f6d-968c-4382b7f4fc30 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:20.498321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4894d4bf-ef27-4f6d-968c-4382b7f4fc30 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:20.498781 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4894d4bf-ef27-4f6d-968c-4382b7f4fc30 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:20.629910 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4894d4bf-ef27-4f6d-968c-4382b7f4fc30 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:20.637490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4894d4bf-ef27-4f6d-968c-4382b7f4fc30 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1366 microversion: 2.1 time: 0.151157 May 12 09:44:20.638091 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 447/898] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:20 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:21.654811 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d10abb0b-f190-49b9-b66b-89495784b0c0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:21.655423 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d10abb0b-f190-49b9-b66b-89495784b0c0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:21.662289 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d10abb0b-f190-49b9-b66b-89495784b0c0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:21.662746 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d10abb0b-f190-49b9-b66b-89495784b0c0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:21.663513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d10abb0b-f190-49b9-b66b-89495784b0c0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:21.663954 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d10abb0b-f190-49b9-b66b-89495784b0c0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:21.794276 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d10abb0b-f190-49b9-b66b-89495784b0c0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:21.803453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d10abb0b-f190-49b9-b66b-89495784b0c0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1366 microversion: 2.1 time: 0.152250 May 12 09:44:21.804165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 452/899] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:21 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:22.016721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-fa5d4c6a-1886-4e6b-b40d-300a40271ca8 req-7b1d6907-629f-4173-b522-0c12cafc73f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe60f94-7d27-4924-8df7-0a49d9455ade", "name": "network-vif-plugged", "status": "completed", "tag": "5fd0072b-c35b-4eb8-95e5-e20e592d7b49"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:22.026154 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-fa5d4c6a-1886-4e6b-b40d-300a40271ca8 req-7b1d6907-629f-4173-b522-0c12cafc73f8 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:22.026611 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-fa5d4c6a-1886-4e6b-b40d-300a40271ca8 req-7b1d6907-629f-4173-b522-0c12cafc73f8 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:22.037917 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-fa5d4c6a-1886-4e6b-b40d-300a40271ca8 req-7b1d6907-629f-4173-b522-0c12cafc73f8 service nova] Creating event network-vif-plugged:5fd0072b-c35b-4eb8-95e5-e20e592d7b49 for instance afe60f94-7d27-4924-8df7-0a49d9455ade on hv-cinder-83769 May 12 09:44:22.042726 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-fa5d4c6a-1886-4e6b-b40d-300a40271ca8 req-7b1d6907-629f-4173-b522-0c12cafc73f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029680 May 12 09:44:22.043308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 448/900] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:22.821962 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e18ac3b8-66ba-473a-9f04-9eb179a0c941 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:22.822586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e18ac3b8-66ba-473a-9f04-9eb179a0c941 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:22.828930 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e18ac3b8-66ba-473a-9f04-9eb179a0c941 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:22.829387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e18ac3b8-66ba-473a-9f04-9eb179a0c941 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:22.830256 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e18ac3b8-66ba-473a-9f04-9eb179a0c941 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:22.830702 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e18ac3b8-66ba-473a-9f04-9eb179a0c941 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:22.959379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e18ac3b8-66ba-473a-9f04-9eb179a0c941 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:22.967092 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e18ac3b8-66ba-473a-9f04-9eb179a0c941 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1366 microversion: 2.1 time: 0.149037 May 12 09:44:22.967654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 453/901] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:22 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:23.984973 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-beeda7c5-a541-446b-8ddb-8666ade5cc0c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:23.985667 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-beeda7c5-a541-446b-8ddb-8666ade5cc0c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:23.992369 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-beeda7c5-a541-446b-8ddb-8666ade5cc0c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:23.992820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-beeda7c5-a541-446b-8ddb-8666ade5cc0c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:23.993577 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-beeda7c5-a541-446b-8ddb-8666ade5cc0c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:23.994054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-beeda7c5-a541-446b-8ddb-8666ade5cc0c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:24.120873 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-beeda7c5-a541-446b-8ddb-8666ade5cc0c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:44:24.128111 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-beeda7c5-a541-446b-8ddb-8666ade5cc0c tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1557 microversion: 2.1 time: 0.147844 May 12 09:44:24.128658 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 449/902] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:44:23 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:44:24.144562 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c0f2b8b7-7bbb-40f1-864f-1baf0f01b80a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:24.145049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c0f2b8b7-7bbb-40f1-864f-1baf0f01b80a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:24.151314 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0f2b8b7-7bbb-40f1-864f-1baf0f01b80a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:24.151762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0f2b8b7-7bbb-40f1-864f-1baf0f01b80a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:24.152525 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0f2b8b7-7bbb-40f1-864f-1baf0f01b80a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:24.152963 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0f2b8b7-7bbb-40f1-864f-1baf0f01b80a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:24.229622 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c0f2b8b7-7bbb-40f1-864f-1baf0f01b80a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088974 May 12 09:44:24.230246 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 454/903] 10.222.0.60 () {58 vars in 1274 bytes} [Thu May 12 09:44:24 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:25.431697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-36eb5b1c-4add-471b-9fd9-6fc7f9c57e86 req-d197b564-dd37-4d34-90bd-64f70473eb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe60f94-7d27-4924-8df7-0a49d9455ade", "tag": "5fd0072b-c35b-4eb8-95e5-e20e592d7b49"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:25.440116 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-36eb5b1c-4add-471b-9fd9-6fc7f9c57e86 req-d197b564-dd37-4d34-90bd-64f70473eb55 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:25.440557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-36eb5b1c-4add-471b-9fd9-6fc7f9c57e86 req-d197b564-dd37-4d34-90bd-64f70473eb55 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:25.451000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-36eb5b1c-4add-471b-9fd9-6fc7f9c57e86 req-d197b564-dd37-4d34-90bd-64f70473eb55 service nova] Creating event network-changed:5fd0072b-c35b-4eb8-95e5-e20e592d7b49 for instance afe60f94-7d27-4924-8df7-0a49d9455ade on hv-cinder-83769 May 12 09:44:25.455688 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-36eb5b1c-4add-471b-9fd9-6fc7f9c57e86 req-d197b564-dd37-4d34-90bd-64f70473eb55 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027625 May 12 09:44:25.456265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 450/904] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:46.938900 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b7e63c55-33b3-46c9-818b-17f449ba1868 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:46.939419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b7e63c55-33b3-46c9-818b-17f449ba1868 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:46.945194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b7e63c55-33b3-46c9-818b-17f449ba1868 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:46.945759 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b7e63c55-33b3-46c9-818b-17f449ba1868 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:46.946550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b7e63c55-33b3-46c9-818b-17f449ba1868 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:46.946986 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b7e63c55-33b3-46c9-818b-17f449ba1868 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:46.969544 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b7e63c55-33b3-46c9-818b-17f449ba1868 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/ips" status: 200 len: 145 microversion: 2.1 time: 0.158983 May 12 09:44:46.970115 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 455/905] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:44:46 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/ips => generated 145 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:48.279146 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-67a11b6d-80fe-49e5-acef-7feb8195251f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a522af3-4f04-42a3-9cea-3eb5283126b7"}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:48.280291 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-67a11b6d-80fe-49e5-acef-7feb8195251f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:48.286799 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67a11b6d-80fe-49e5-acef-7feb8195251f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:48.287272 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67a11b6d-80fe-49e5-acef-7feb8195251f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:48.288028 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67a11b6d-80fe-49e5-acef-7feb8195251f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:48.288461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67a11b6d-80fe-49e5-acef-7feb8195251f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:48.533410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-67a11b6d-80fe-49e5-acef-7feb8195251f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258930 May 12 09:44:48.534592 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 451/906] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:44:48 2022] POST /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:56.005080 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d0d1a67f-9c2e-43c8-9524-dbb30c9e9577 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:56.006529 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d0d1a67f-9c2e-43c8-9524-dbb30c9e9577 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:56.013837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d0d1a67f-9c2e-43c8-9524-dbb30c9e9577 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:56.014313 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d0d1a67f-9c2e-43c8-9524-dbb30c9e9577 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:56.015077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d0d1a67f-9c2e-43c8-9524-dbb30c9e9577 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:56.015506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d0d1a67f-9c2e-43c8-9524-dbb30c9e9577 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:56.045953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d0d1a67f-9c2e-43c8-9524-dbb30c9e9577 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 May 12 09:44:56.046558 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 456/907] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:44:55 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:56.057820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1f96e857-a0f1-45d9-9acc-c8e61b18953d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:44:56.058404 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1f96e857-a0f1-45d9-9acc-c8e61b18953d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:56.064635 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1f96e857-a0f1-45d9-9acc-c8e61b18953d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:56.065077 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1f96e857-a0f1-45d9-9acc-c8e61b18953d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:56.066510 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1f96e857-a0f1-45d9-9acc-c8e61b18953d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:56.066948 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1f96e857-a0f1-45d9-9acc-c8e61b18953d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:56.094179 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1f96e857-a0f1-45d9-9acc-c8e61b18953d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/4a522af3-4f04-42a3-9cea-3eb5283126b7" status: 200 len: 194 microversion: 2.1 time: 0.041064 May 12 09:44:56.094749 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 452/908] 10.222.0.60 () {58 vars in 1412 bytes} [Thu May 12 09:44:56 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/4a522af3-4f04-42a3-9cea-3eb5283126b7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:44:57.393279 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f942134e-f5af-4d56-b4df-6d322167f3af tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a2499e6-6455-4118-999e-8237d3aa61e7"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:44:57.394947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f942134e-f5af-4d56-b4df-6d322167f3af tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:44:57.401182 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f942134e-f5af-4d56-b4df-6d322167f3af tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:57.401633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f942134e-f5af-4d56-b4df-6d322167f3af tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:57.402434 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f942134e-f5af-4d56-b4df-6d322167f3af tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:44:57.402876 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f942134e-f5af-4d56-b4df-6d322167f3af tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:44:57.644585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f942134e-f5af-4d56-b4df-6d322167f3af tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "POST /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255159 May 12 09:44:57.645185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 457/909] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:44:57 2022] POST /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:45:05.112097 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0ffdf301-1e92-4763-b685-81efb8877810 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:05.113708 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0ffdf301-1e92-4763-b685-81efb8877810 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:05.119955 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0ffdf301-1e92-4763-b685-81efb8877810 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:05.120406 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0ffdf301-1e92-4763-b685-81efb8877810 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:05.121169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0ffdf301-1e92-4763-b685-81efb8877810 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:05.121609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0ffdf301-1e92-4763-b685-81efb8877810 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:05.150483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0ffdf301-1e92-4763-b685-81efb8877810 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042233 May 12 09:45:05.150963 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 453/910] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:45:05 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:45:05.289290 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-174b9397-dcea-4d33-86c5-8f7039a2c2cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:05.289919 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-174b9397-dcea-4d33-86c5-8f7039a2c2cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:05.295988 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-174b9397-dcea-4d33-86c5-8f7039a2c2cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:05.296432 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-174b9397-dcea-4d33-86c5-8f7039a2c2cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:05.297188 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-174b9397-dcea-4d33-86c5-8f7039a2c2cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:05.297621 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-174b9397-dcea-4d33-86c5-8f7039a2c2cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:05.324900 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-174b9397-dcea-4d33-86c5-8f7039a2c2cb tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/4a522af3-4f04-42a3-9cea-3eb5283126b7" status: 200 len: 194 microversion: 2.1 time: 0.040987 May 12 09:45:05.325455 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 458/911] 10.222.0.60 () {58 vars in 1412 bytes} [Thu May 12 09:45:05 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/4a522af3-4f04-42a3-9cea-3eb5283126b7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:45:05.335000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d98596c1-bce6-409a-afc2-2d1684e9c5c0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:05.335489 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d98596c1-bce6-409a-afc2-2d1684e9c5c0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:05.341213 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d98596c1-bce6-409a-afc2-2d1684e9c5c0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:05.341691 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d98596c1-bce6-409a-afc2-2d1684e9c5c0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:05.342480 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d98596c1-bce6-409a-afc2-2d1684e9c5c0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:05.342916 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d98596c1-bce6-409a-afc2-2d1684e9c5c0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:05.420840 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-d98596c1-bce6-409a-afc2-2d1684e9c5c0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lazy-loading 'services' on Instance uuid 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:45:05.487939 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d98596c1-bce6-409a-afc2-2d1684e9c5c0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/4a522af3-4f04-42a3-9cea-3eb5283126b7" status: 202 len: 0 microversion: 2.1 time: 0.156687 May 12 09:45:05.488507 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 454/912] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:45:05 2022] DELETE /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/4a522af3-4f04-42a3-9cea-3eb5283126b7 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:45:07.648979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e9d7c65c-cd49-41e4-97cf-bf38eeb9ff5f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:07.649505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e9d7c65c-cd49-41e4-97cf-bf38eeb9ff5f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:07.655720 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9d7c65c-cd49-41e4-97cf-bf38eeb9ff5f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:07.656182 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9d7c65c-cd49-41e4-97cf-bf38eeb9ff5f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:07.656920 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9d7c65c-cd49-41e4-97cf-bf38eeb9ff5f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:07.657347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9d7c65c-cd49-41e4-97cf-bf38eeb9ff5f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:07.684856 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e9d7c65c-cd49-41e4-97cf-bf38eeb9ff5f tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/5a2499e6-6455-4118-999e-8237d3aa61e7" status: 200 len: 194 microversion: 2.1 time: 0.039802 May 12 09:45:07.685408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 459/913] 10.222.0.60 () {58 vars in 1412 bytes} [Thu May 12 09:45:07 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/5a2499e6-6455-4118-999e-8237d3aa61e7 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:45:07.695841 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9a6f15c6-9fe2-4928-9939-aed067cc45e0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:07.696414 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9a6f15c6-9fe2-4928-9939-aed067cc45e0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:07.702331 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a6f15c6-9fe2-4928-9939-aed067cc45e0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:07.702777 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a6f15c6-9fe2-4928-9939-aed067cc45e0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:07.703646 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a6f15c6-9fe2-4928-9939-aed067cc45e0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:07.704080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9a6f15c6-9fe2-4928-9939-aed067cc45e0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:07.781192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-9a6f15c6-9fe2-4928-9939-aed067cc45e0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lazy-loading 'services' on Instance uuid 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:45:07.848936 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9a6f15c6-9fe2-4928-9939-aed067cc45e0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/5a2499e6-6455-4118-999e-8237d3aa61e7" status: 202 len: 0 microversion: 2.1 time: 0.157582 May 12 09:45:07.849533 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 455/914] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:45:07 2022] DELETE /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments/5a2499e6-6455-4118-999e-8237d3aa61e7 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:45:09.001477 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-48138695-57e8-4fa7-8b68-43676b691911 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:09.002492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-48138695-57e8-4fa7-8b68-43676b691911 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:09.008803 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-48138695-57e8-4fa7-8b68-43676b691911 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:09.009293 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-48138695-57e8-4fa7-8b68-43676b691911 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:09.010347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-48138695-57e8-4fa7-8b68-43676b691911 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:09.010787 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-48138695-57e8-4fa7-8b68-43676b691911 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:09.038511 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-48138695-57e8-4fa7-8b68-43676b691911 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040995 May 12 09:45:09.039049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 460/915] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:45:08 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 09:45:09.142486 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a5325bc1-7243-487f-9c50-915bcc930bef tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:09.143997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a5325bc1-7243-487f-9c50-915bcc930bef tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:09.149989 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a5325bc1-7243-487f-9c50-915bcc930bef tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:09.150443 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a5325bc1-7243-487f-9c50-915bcc930bef tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:09.151203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a5325bc1-7243-487f-9c50-915bcc930bef tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:09.151640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a5325bc1-7243-487f-9c50-915bcc930bef tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:09.179666 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a5325bc1-7243-487f-9c50-915bcc930bef tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041810 May 12 09:45:09.180138 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 456/916] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:45:09 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 09:45:09.235191 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cbe96881-768f-486c-a0ce-94fd16cfe2a8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:09.235839 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cbe96881-768f-486c-a0ce-94fd16cfe2a8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:09.241666 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cbe96881-768f-486c-a0ce-94fd16cfe2a8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:09.242162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cbe96881-768f-486c-a0ce-94fd16cfe2a8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:09.242968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cbe96881-768f-486c-a0ce-94fd16cfe2a8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:09.243408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cbe96881-768f-486c-a0ce-94fd16cfe2a8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:09.267770 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cbe96881-768f-486c-a0ce-94fd16cfe2a8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:45:09.342659 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cbe96881-768f-486c-a0ce-94fd16cfe2a8 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 204 len: 0 microversion: 2.1 time: 0.110980 May 12 09:45:09.343628 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 461/917] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:45:09 2022] DELETE /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:45:09.352041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-be9ed17e-c143-4fba-918d-476ce964c6e5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:09.352643 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-be9ed17e-c143-4fba-918d-476ce964c6e5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:09.358395 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-be9ed17e-c143-4fba-918d-476ce964c6e5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:09.358839 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-be9ed17e-c143-4fba-918d-476ce964c6e5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:09.359591 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-be9ed17e-c143-4fba-918d-476ce964c6e5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:09.360018 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-be9ed17e-c143-4fba-918d-476ce964c6e5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:09.488756 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-be9ed17e-c143-4fba-918d-476ce964c6e5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:09.495885 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-be9ed17e-c143-4fba-918d-476ce964c6e5 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1673 microversion: 2.1 time: 0.147711 May 12 09:45:09.496440 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 457/918] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:09 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:45:10.513454 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6f00e181-6717-4f93-bcf8-5ea8c88912b2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:10.514175 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6f00e181-6717-4f93-bcf8-5ea8c88912b2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:10.521208 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f00e181-6717-4f93-bcf8-5ea8c88912b2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:10.521655 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f00e181-6717-4f93-bcf8-5ea8c88912b2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:10.522460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f00e181-6717-4f93-bcf8-5ea8c88912b2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:10.522897 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6f00e181-6717-4f93-bcf8-5ea8c88912b2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:10.649118 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6f00e181-6717-4f93-bcf8-5ea8c88912b2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:10.656391 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6f00e181-6717-4f93-bcf8-5ea8c88912b2 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1673 microversion: 2.1 time: 0.147580 May 12 09:45:10.656953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 462/919] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:10 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:45:11.673567 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2e5d748a-ea49-4866-b083-00bd994688d0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:11.674163 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2e5d748a-ea49-4866-b083-00bd994688d0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:11.680390 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2e5d748a-ea49-4866-b083-00bd994688d0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:11.680841 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2e5d748a-ea49-4866-b083-00bd994688d0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:11.681596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2e5d748a-ea49-4866-b083-00bd994688d0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:11.682063 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2e5d748a-ea49-4866-b083-00bd994688d0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:11.807296 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2e5d748a-ea49-4866-b083-00bd994688d0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:11.814587 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2e5d748a-ea49-4866-b083-00bd994688d0 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1673 microversion: 2.1 time: 0.144925 May 12 09:45:11.815148 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 458/920] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:11 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:45:12.833079 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-49cd6b4e-7a30-438c-91c6-4091555ca1d7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:12.833689 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-49cd6b4e-7a30-438c-91c6-4091555ca1d7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:12.841526 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-49cd6b4e-7a30-438c-91c6-4091555ca1d7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:12.842944 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-49cd6b4e-7a30-438c-91c6-4091555ca1d7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:12.843992 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-49cd6b4e-7a30-438c-91c6-4091555ca1d7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:12.844661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-49cd6b4e-7a30-438c-91c6-4091555ca1d7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:12.897930 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-60078ac9-8718-43df-b0b9-af0376c593a8 req-3f39a1b5-f36c-4e95-b897-788cd47cbd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa", "name": "network-vif-deleted", "tag": "953ead63-0e69-4d22-b2b3-ae09ec6491e1"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:45:12.911707 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-60078ac9-8718-43df-b0b9-af0376c593a8 req-3f39a1b5-f36c-4e95-b897-788cd47cbd54 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:12.912159 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-60078ac9-8718-43df-b0b9-af0376c593a8 req-3f39a1b5-f36c-4e95-b897-788cd47cbd54 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:12.935387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-60078ac9-8718-43df-b0b9-af0376c593a8 req-3f39a1b5-f36c-4e95-b897-788cd47cbd54 service nova] Creating event network-vif-deleted:953ead63-0e69-4d22-b2b3-ae09ec6491e1 for instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa on hv-cinder-83769 May 12 09:45:12.940566 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-49cd6b4e-7a30-438c-91c6-4091555ca1d7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efdff1c390f4271963e932af8abd473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9f41ad6b4506872df6cb86ae9f73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:12.947640 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-60078ac9-8718-43df-b0b9-af0376c593a8 req-3f39a1b5-f36c-4e95-b897-788cd47cbd54 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145852 May 12 09:45:12.948152 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-49cd6b4e-7a30-438c-91c6-4091555ca1d7 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 200 len: 1322 microversion: 2.1 time: 0.119422 May 12 09:45:12.948504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 463/921] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:45:12.948735 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 459/922] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:12 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 1322 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:45:13.966409 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:13.967090 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:13.973744 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:13.974215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:13.974987 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:13.975416 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:13.988284 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] HTTP exception thrown: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Request method failure captured: May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa HTTP/1.1 May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNSGt7-tJ3ngUifuY0pIPlIXxNlwsh59MeQqIW7heJWWR-zSFLUDT8GZindeWgyl44aNsXdx32pfC8HmpkrNt_ym3dp0NehIkZFjuc4lFVoqxQpuVpWG614u7EE6RYp4BF9i9_Iast1cNL4q6adVeD-TYK8NeaWRldJ5mfR9Zf65kVg May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:45:13.989862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da5b9f41ad6b4506872df6cb86ae9f73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}] May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 2efdff1c390f4271963e932af8abd473 May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:13.991506 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa'} May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:45:13.992348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:13.993927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:13.995317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Returning 404 to user: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:45:13.995317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-36d3b489-0cd7-42e2-8944-87a2759d1ccd tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 404 len: 111 microversion: 2.1 time: 0.029542 May 12 09:45:13.995317 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 464/923] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:13 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:45:14.000173 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c78dd676-b645-443c-9357-44ccd1be31d3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '.version_select at 0x7f872b2958b0>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:14.024435 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c78dd676-b645-443c-9357-44ccd1be31d3 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047819638" status: 202 len: 0 microversion: 2.1 time: 0.028020 May 12 09:45:14.024998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 460/924] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 12 09:45:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047819638 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:45:16.874977 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:16.875477 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:16.881666 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:16.882145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:16.882924 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:16.883336 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:16.896550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] HTTP exception thrown: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Request method failure captured: May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: DELETE /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa HTTP/1.1 May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNSGt7-tJ3ngUifuY0pIPlIXxNlwsh59MeQqIW7heJWWR-zSFLUDT8GZindeWgyl44aNsXdx32pfC8HmpkrNt_ym3dp0NehIkZFjuc4lFVoqxQpuVpWG614u7EE6RYp4BF9i9_Iast1cNL4q6adVeD-TYK8NeaWRldJ5mfR9Zf65kVg May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:45:16.898098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da5b9f41ad6b4506872df6cb86ae9f73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}] May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 2efdff1c390f4271963e932af8abd473 May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.899643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa'} May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:45:16.900610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.902167 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:16.903742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Returning 404 to user: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:45:16.903742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-05799eb5-1226-4a46-87ac-a42a1224269c tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 404 len: 111 microversion: 2.1 time: 0.028351 May 12 09:45:16.903742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 465/925] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:45:16 2022] DELETE /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:45:16.908300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:16.909394 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:16.915821 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:16.916276 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:16.917040 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:16.917481 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:16.930764 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] HTTP exception thrown: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Request method failure captured: May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa HTTP/1.1 May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNSGt7-tJ3ngUifuY0pIPlIXxNlwsh59MeQqIW7heJWWR-zSFLUDT8GZindeWgyl44aNsXdx32pfC8HmpkrNt_ym3dp0NehIkZFjuc4lFVoqxQpuVpWG614u7EE6RYp4BF9i9_Iast1cNL4q6adVeD-TYK8NeaWRldJ5mfR9Zf65kVg May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:45:16.932384 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da5b9f41ad6b4506872df6cb86ae9f73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}] May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 2efdff1c390f4271963e932af8abd473 May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.934010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa'} May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:45:16.935046 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. May 12 09:45:16.936492 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:16.937944 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Returning 404 to user: Instance 1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:45:16.937944 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d0b3e6d1-2ae9-4559-8601-1a72084ff613 tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa" status: 404 len: 111 microversion: 2.1 time: 0.029789 May 12 09:45:16.937944 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 461/926] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:16 2022] GET /compute/v2.1/servers/1c8cb5b3-daa4-417d-807d-1f8c8d2bd7fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:45:17.906500 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bf5dc881-0952-4739-83f2-4a3df274a15f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:17.907058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-bf5dc881-0952-4739-83f2-4a3df274a15f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:17.913836 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bf5dc881-0952-4739-83f2-4a3df274a15f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:17.914309 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bf5dc881-0952-4739-83f2-4a3df274a15f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:17.915074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bf5dc881-0952-4739-83f2-4a3df274a15f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:17.915515 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bf5dc881-0952-4739-83f2-4a3df274a15f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:17.937620 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-bf5dc881-0952-4739-83f2-4a3df274a15f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/ips" status: 200 len: 152 microversion: 2.20 time: 0.035099 May 12 09:45:17.938192 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 466/927] 10.222.0.60 () {60 vars in 1288 bytes} [Thu May 12 09:45:17 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:45:18.067940 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:18.068462 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:18.075351 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:18.075870 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:18.076797 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:18.077296 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:18.092591 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] HTTP exception thrown: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Request method failure captured: May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: DELETE /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 HTTP/1.1 May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNSGt7-tJ3ngUifuY0pIPlIXxNlwsh59MeQqIW7heJWWR-zSFLUDT8GZindeWgyl44aNsXdx32pfC8HmpkrNt_ym3dp0NehIkZFjuc4lFVoqxQpuVpWG614u7EE6RYp4BF9i9_Iast1cNL4q6adVeD-TYK8NeaWRldJ5mfR9Zf65kVg May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:45:18.094184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da5b9f41ad6b4506872df6cb86ae9f73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}] May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 2efdff1c390f4271963e932af8abd473 May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.095656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '3dadb998-7d24-461d-bf2f-cec5ab30fb48'} May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:45:18.096776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.099054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:18.100613 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Returning 404 to user: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:45:18.100613 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7a928e9a-d6d3-4151-bbff-d234ea38454d tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 404 len: 111 microversion: 2.1 time: 0.031617 May 12 09:45:18.100613 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 462/928] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:45:18 2022] DELETE /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:45:18.107842 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:18.108499 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] [instance: 3dadb998-7d24-461d-bf2f-cec5ab30fb48] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:18.114788 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:18.115246 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:18.116017 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:18.116463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:18.130983 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] HTTP exception thrown: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Request method failure captured: May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 HTTP/1.1 May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNSGt7-tJ3ngUifuY0pIPlIXxNlwsh59MeQqIW7heJWWR-zSFLUDT8GZindeWgyl44aNsXdx32pfC8HmpkrNt_ym3dp0NehIkZFjuc4lFVoqxQpuVpWG614u7EE6RYp4BF9i9_Iast1cNL4q6adVeD-TYK8NeaWRldJ5mfR9Zf65kVg May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:45:18.132504 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_da5b9f41ad6b4506872df6cb86ae9f73", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/da5b9f41ad6b4506872df6cb86ae9f73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/da5b9f41ad6b4506872df6cb86ae9f73"}]}] May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: da5b9f41ad6b4506872df6cb86ae9f73 May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeTestJSON-486367027 May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 2efdff1c390f4271963e932af8abd473 May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeTestJSON-486367027-project May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.134037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '3dadb998-7d24-461d-bf2f-cec5ab30fb48'} May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:45:18.134809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. May 12 09:45:18.136295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:45:18.137505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] Returning 404 to user: Instance 3dadb998-7d24-461d-bf2f-cec5ab30fb48 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:45:18.137505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-bbcb7e7c-a5c1-4d01-929e-c64cfaee30cf tempest-AttachVolumeTestJSON-486367027 tempest-AttachVolumeTestJSON-486367027-project] 10.222.0.60 "GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48" status: 404 len: 111 microversion: 2.1 time: 0.030129 May 12 09:45:18.137505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 467/929] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:18 2022] GET /compute/v2.1/servers/3dadb998-7d24-461d-bf2f-cec5ab30fb48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:45:19.816107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-38d1acb4-8169-4b19-90e7-1debbb3538bd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:45:19.816663 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-38d1acb4-8169-4b19-90e7-1debbb3538bd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:19.822770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-38d1acb4-8169-4b19-90e7-1debbb3538bd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:19.823217 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-38d1acb4-8169-4b19-90e7-1debbb3538bd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:19.823992 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-38d1acb4-8169-4b19-90e7-1debbb3538bd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:19.824423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-38d1acb4-8169-4b19-90e7-1debbb3538bd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:19.847746 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-38d1acb4-8169-4b19-90e7-1debbb3538bd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lazy-loading 'flavor' on Instance uuid 18552b7d-9ecc-4182-b0fd-726899815dcf {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:45:20.112131 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-38d1acb4-8169-4b19-90e7-1debbb3538bd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/action" status: 202 len: 0 microversion: 2.20 time: 0.300254 May 12 09:45:20.113034 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 463/930] 10.222.0.60 () {62 vars in 1318 bytes} [Thu May 12 09:45:19 2022] POST /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 09:45:20.127374 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:20.128000 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:20.142668 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:20.146452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:20.147569 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:20.148016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:20.376589 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:20.384460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:20.386396 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:20.387572 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f69a626f-26f7-48b9-8b68-d95fa5fafc0d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.270226 May 12 09:45:20.388129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 468/931] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:20 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:45:21.408853 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:21.410132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:21.417648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:21.418382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:21.419178 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:21.419619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:21.618368 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:21.628058 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:21.630684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:21.632318 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-63ebab2e-2da0-4db7-ac8b-7f7185e591b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.228877 May 12 09:45:21.632911 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 464/932] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:21 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:22.658468 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:22.659065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:22.665853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:22.666337 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:22.667107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:22.667547 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:22.797513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:22.807723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:22.809248 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:22.810681 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-36080959-6c1e-4967-a63e-aea802ecaa3e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.155819 May 12 09:45:22.811357 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 469/933] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:22 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:23.829848 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:23.830542 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:23.837521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:23.838042 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:23.838825 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:23.839265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:23.974117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:23.981761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:23.983404 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:23.984662 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-de5ef462-bffb-4dee-8fc6-76f5b68df193 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.158807 May 12 09:45:23.985294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 465/934] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:23 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:25.003733 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:25.004242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:25.010988 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:25.011439 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:25.012213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:25.012653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:25.150777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:25.158427 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:25.160413 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:25.161554 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8b22c8c7-bee9-4e5f-a316-6b4176ee3f01 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.162439 May 12 09:45:25.162130 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 470/935] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:24 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:26.179859 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:26.180398 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:26.186827 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:26.187274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:26.188032 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:26.188466 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:26.322374 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:26.330796 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:26.332311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:26.333446 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2cf712a0-3270-4fa4-a203-4190e2fc8b65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.157526 May 12 09:45:26.334013 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 466/936] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:26 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:27.351667 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:27.352216 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:27.358580 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:27.359037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:27.359807 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:27.360249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:27.485260 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:27.493184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:27.494742 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:27.495925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-623a259c-fd8f-4300-8368-0a96ea42ccee tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.148270 May 12 09:45:27.496476 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 471/937] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:27 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:28.514053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:28.514672 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:28.521325 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:28.521770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:28.522550 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:28.522982 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:28.651736 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:28.660022 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:28.661690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:28.662780 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e075179d-8637-4568-b49a-d275062bf1c4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.152921 May 12 09:45:28.663337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 467/938] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:28 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:29.680384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:29.681009 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:29.687027 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:29.687482 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:29.688338 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:29.688782 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:29.813223 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:29.821487 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:29.823013 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:29.824160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-13bfa670-6ce2-4e8a-afdb-05f664700d57 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.147609 May 12 09:45:29.824712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 472/939] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:29 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:30.842107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:30.842710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:30.849558 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:30.850033 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:30.850797 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:30.851234 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:30.977808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:30.985824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:30.987356 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:30.988506 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1ad159de-a977-42bf-8329-128212958dbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.151116 May 12 09:45:30.989074 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 468/940] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:30 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:32.010125 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:32.010958 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:32.017388 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:32.017847 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:32.018736 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:32.019757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:32.145625 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:32.153322 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:32.154876 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:32.156032 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-49425095-d780-4ada-af9a-4596f4b0f8a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.149917 May 12 09:45:32.156586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 473/941] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:32 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:33.175595 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:33.176134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:33.182464 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:33.182914 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:33.183670 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:33.184103 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:33.306270 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:33.313808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:33.315318 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:33.316454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-99c9f9dd-2914-420e-92a9-da7b32dfb872 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.145391 May 12 09:45:33.317007 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 469/942] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:33 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:45:34.334409 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:34.335138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:34.341454 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:34.341925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:34.342683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:34.343118 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:34.472705 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:34.480357 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:34.481839 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:34.482997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a9434cca-eab4-4426-a059-b5e046bc9c97 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.152535 May 12 09:45:34.483537 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 474/943] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:34 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:35.500682 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:35.501268 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:35.508125 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:35.508576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:35.509344 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:35.509784 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:35.633927 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:35.641823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:35.643375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:35.645132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8dd11c27-bdb0-41e1-bd2c-cd7a090740b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.148366 May 12 09:45:35.645693 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 470/944] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:35 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:36.663203 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:36.663794 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:36.670163 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:36.670619 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:36.671387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:36.671826 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:36.799111 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:36.807277 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:36.808771 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:36.809928 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c9dd8226-0ad3-4d22-a900-8f3b02c6b118 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.150658 May 12 09:45:36.810487 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 475/945] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:36 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:37.828322 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:37.828920 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:37.835620 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:37.836070 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:37.836855 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:37.837294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:37.972740 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:37.980428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:37.981927 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:37.983097 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7900f3b8-7e24-4b6e-bc8a-7232d79102e7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.158725 May 12 09:45:37.983655 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 471/946] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:37 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:39.000510 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:39.001119 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:39.007480 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:39.007933 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:39.008697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:39.009133 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:39.136641 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:39.144846 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:39.146356 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:39.147500 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2fb33a60-6651-4de6-af39-6bc6af012b4a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1746 microversion: 2.20 time: 0.150894 May 12 09:45:39.148047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 476/947] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:38 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:40.165820 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:40.166458 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:40.172647 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:40.173092 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:40.173845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:40.174304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:40.302184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:40.309887 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:40.311430 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:40.312574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-27ac1bf3-072e-4fda-9061-3e53976d78ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1746 microversion: 2.20 time: 0.150611 May 12 09:45:40.313169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 472/948] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:40 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:41.331012 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:41.332049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:41.338009 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:41.338464 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:41.339230 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:41.339668 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:41.466272 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:41.473964 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:41.475465 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:41.476613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2c98b62e-eb99-4024-9ae1-3c923778cbdc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1746 microversion: 2.20 time: 0.149756 May 12 09:45:41.477158 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 477/949] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:41 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:42.494689 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:42.495281 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:42.501785 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:42.502260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:42.503018 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:42.503454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:42.629396 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:42.637258 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:42.638901 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:42.640044 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-59ccea70-5699-4c23-9850-e41d5ce8a400 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1746 microversion: 2.20 time: 0.149266 May 12 09:45:42.640600 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 473/950] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:42 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:43.658544 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:43.659627 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:43.665822 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:43.666352 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:43.667103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:43.667535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:43.791061 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:43.798620 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:43.801053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:43.802499 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-09f61563-fc80-4073-815f-93cbcde1bbaa tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1746 microversion: 2.20 time: 0.147515 May 12 09:45:43.802767 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 478/951] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:43 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:44.820967 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:44.821545 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:44.828044 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:44.828490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:44.829269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:44.829685 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:44.969532 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:44.978158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:44.979660 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:44.980823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2ce965e3-1091-4bd6-b67e-2f5a236cbd4d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1746 microversion: 2.20 time: 0.163869 May 12 09:45:44.981385 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 474/952] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:44 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:46.000030 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:46.000637 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:46.007524 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:46.007979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:46.008844 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:46.009295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:46.133178 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:46.141087 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:46.142617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:46.144321 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b42ff8f7-8c11-4276-93ac-0311713008eb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1746 microversion: 2.20 time: 0.147687 May 12 09:45:46.144869 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 479/953] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:45 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:47.162239 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:47.162787 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:47.168763 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:47.169214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:47.170003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:47.170449 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:47.293825 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:47.302091 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:47.303594 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:47.304748 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d1fe4094-a3ba-4dc4-98ea-9b830aa767f3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1746 microversion: 2.20 time: 0.146492 May 12 09:45:47.305316 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 475/954] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:47 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:48.324458 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:48.325053 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:48.332042 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:48.332498 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:48.333266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:48.333710 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:48.459908 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:48.467645 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:48.469161 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:48.470354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2fb32890-f742-4314-9324-459a6d4feb8c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1746 microversion: 2.20 time: 0.149866 May 12 09:45:48.470910 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 480/955] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:48 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:48.824334 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-82c75d78-6898-4f37-868c-56a7a35d69b2 req-b9c45193-5416-4530-894f-78db80bbb70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18552b7d-9ecc-4182-b0fd-726899815dcf", "name": "network-vif-plugged", "status": "completed", "tag": "b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:45:48.832104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-82c75d78-6898-4f37-868c-56a7a35d69b2 req-b9c45193-5416-4530-894f-78db80bbb70d service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:48.832544 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-82c75d78-6898-4f37-868c-56a7a35d69b2 req-b9c45193-5416-4530-894f-78db80bbb70d service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:48.843538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-82c75d78-6898-4f37-868c-56a7a35d69b2 req-b9c45193-5416-4530-894f-78db80bbb70d service nova] Creating event network-vif-plugged:b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b for instance 18552b7d-9ecc-4182-b0fd-726899815dcf on hv-cinder-83769 May 12 09:45:48.848598 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-82c75d78-6898-4f37-868c-56a7a35d69b2 req-b9c45193-5416-4530-894f-78db80bbb70d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145718 May 12 09:45:48.849341 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 476/956] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:45:49.490390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:49.491001 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:49.497159 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:49.497683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:49.498492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:49.498988 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:49.630940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:49.640215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:49.641726 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:49.642935 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8c6b5c69-0e3f-4eb4-acdd-54b2b45affcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.157217 May 12 09:45:49.644083 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 481/957] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:49 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:50.664411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:50.665731 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:50.676361 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:50.677734 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:50.679621 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:50.680352 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:50.826092 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:50.834672 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:50.836247 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:50.837510 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-fba3ad3b-0351-4e01-bf23-1ae4e3ea8d4f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.178675 May 12 09:45:50.838149 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 477/958] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:50 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:51.856627 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:51.857243 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:51.876311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:51.876772 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:51.877580 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:51.878615 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:52.058278 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:52.067714 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:52.069590 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:52.070890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-07765431-5ca1-4722-bb74-488041bd26e0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.218302 May 12 09:45:52.071654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 482/959] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:51 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:45:53.089048 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:53.090522 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:53.097470 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:53.098223 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:53.099000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:53.099604 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:53.323144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:53.332885 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:53.334442 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:53.335618 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-76ec662c-db54-4660-bf57-49e8da18a2b3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.250421 May 12 09:45:53.336170 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 478/960] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:53 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:53.422529 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c5863350-9f94-4bb2-b0ec-d4d2e4264bb5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:53.423057 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c5863350-9f94-4bb2-b0ec-d4d2e4264bb5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:53.431482 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5863350-9f94-4bb2-b0ec-d4d2e4264bb5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:53.431952 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5863350-9f94-4bb2-b0ec-d4d2e4264bb5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:53.432738 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5863350-9f94-4bb2-b0ec-d4d2e4264bb5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:53.433185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5863350-9f94-4bb2-b0ec-d4d2e4264bb5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:53.505144 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c5863350-9f94-4bb2-b0ec-d4d2e4264bb5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:45:53.641495 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-c30de519-548d-4cc2-a070-ee33b742ad1f req-b4120dfd-2201-4c16-afce-8e7c340a0b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5697f44b-088d-48ee-89a1-ae6d09f7d47f", "tag": "24fe4aa4-21d7-4953-acd5-384b86945694"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:45:53.656262 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-c30de519-548d-4cc2-a070-ee33b742ad1f req-b4120dfd-2201-4c16-afce-8e7c340a0b71 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:53.657251 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-c30de519-548d-4cc2-a070-ee33b742ad1f req-b4120dfd-2201-4c16-afce-8e7c340a0b71 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:53.680446 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c5863350-9f94-4bb2-b0ec-d4d2e4264bb5 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "DELETE /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 204 len: 0 microversion: 2.1 time: 0.260679 May 12 09:45:53.683492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 483/961] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:45:53 2022] DELETE /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:45:53.698498 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d958d360-df93-42ea-a8ee-2f3005cb2ddb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:53.699242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d958d360-df93-42ea-a8ee-2f3005cb2ddb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:53.716669 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d958d360-df93-42ea-a8ee-2f3005cb2ddb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:53.718953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d958d360-df93-42ea-a8ee-2f3005cb2ddb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:53.720871 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d958d360-df93-42ea-a8ee-2f3005cb2ddb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:53.723767 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d958d360-df93-42ea-a8ee-2f3005cb2ddb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:53.896347 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-c30de519-548d-4cc2-a070-ee33b742ad1f req-b4120dfd-2201-4c16-afce-8e7c340a0b71 service nova] Creating event network-changed:24fe4aa4-21d7-4953-acd5-384b86945694 for instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f on hv-cinder-83769 May 12 09:45:53.915776 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-c30de519-548d-4cc2-a070-ee33b742ad1f req-b4120dfd-2201-4c16-afce-8e7c340a0b71 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489548 May 12 09:45:53.916599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 479/962] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:45:54.002482 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d958d360-df93-42ea-a8ee-2f3005cb2ddb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:54.010055 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d958d360-df93-42ea-a8ee-2f3005cb2ddb tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.322073 May 12 09:45:54.011497 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 484/963] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:53 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:45:54.354562 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:54.356357 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:54.366483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:54.367076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:54.368000 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:54.368542 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:54.529453 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:54.540652 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:54.542469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:54.543874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d3a03b48-6d1b-4e9a-80a7-f77d8fc9cd18 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.194435 May 12 09:45:54.554919 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 480/964] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:54 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:45:55.029494 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-29e75faf-85a9-4d1e-803c-22667a19f431 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:55.034960 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-29e75faf-85a9-4d1e-803c-22667a19f431 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:55.044184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29e75faf-85a9-4d1e-803c-22667a19f431 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:55.044686 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29e75faf-85a9-4d1e-803c-22667a19f431 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:55.045647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29e75faf-85a9-4d1e-803c-22667a19f431 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:55.046103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29e75faf-85a9-4d1e-803c-22667a19f431 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:55.505149 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-29e75faf-85a9-4d1e-803c-22667a19f431 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:55.513166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-29e75faf-85a9-4d1e-803c-22667a19f431 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.488246 May 12 09:45:55.523697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 485/965] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:55 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:45:55.566963 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:55.568123 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:55.575626 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:55.576103 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:55.577239 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:55.577689 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:55.861287 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:55.883517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:55.886774 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:55.895353 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-03015b53-7a27-47c0-8463-d7ad196da8fc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.333148 May 12 09:45:55.895353 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 481/966] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:55 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:45:56.533371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bdc83557-319c-42a8-acce-d4ab7ca050c2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:56.535951 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-bdc83557-319c-42a8-acce-d4ab7ca050c2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:56.549098 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bdc83557-319c-42a8-acce-d4ab7ca050c2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:56.552848 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bdc83557-319c-42a8-acce-d4ab7ca050c2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:56.553960 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bdc83557-319c-42a8-acce-d4ab7ca050c2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:56.554718 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bdc83557-319c-42a8-acce-d4ab7ca050c2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:56.770612 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-bdc83557-319c-42a8-acce-d4ab7ca050c2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde21f628031431583e085d26485451d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170aaa04d8fe4170bf344d5667ae2814', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:56.778645 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-bdc83557-319c-42a8-acce-d4ab7ca050c2 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 200 len: 1568 microversion: 2.1 time: 0.251543 May 12 09:45:56.781730 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 486/967] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:56 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:45:56.799183 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-ca55ede5-eb67-4e06-b1be-60980e3612a7 req-6dee95d2-81ad-4ab2-9505-398bb0d7b299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5697f44b-088d-48ee-89a1-ae6d09f7d47f", "name": "network-vif-deleted", "tag": "24fe4aa4-21d7-4953-acd5-384b86945694"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:45:56.810553 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-ca55ede5-eb67-4e06-b1be-60980e3612a7 req-6dee95d2-81ad-4ab2-9505-398bb0d7b299 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:56.811284 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-ca55ede5-eb67-4e06-b1be-60980e3612a7 req-6dee95d2-81ad-4ab2-9505-398bb0d7b299 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:56.832495 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-ca55ede5-eb67-4e06-b1be-60980e3612a7 req-6dee95d2-81ad-4ab2-9505-398bb0d7b299 service nova] Creating event network-vif-deleted:24fe4aa4-21d7-4953-acd5-384b86945694 for instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f on hv-cinder-83769 May 12 09:45:56.838866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-ca55ede5-eb67-4e06-b1be-60980e3612a7 req-6dee95d2-81ad-4ab2-9505-398bb0d7b299 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043638 May 12 09:45:56.843508 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 482/968] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:45:56.910350 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:56.911246 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:56.917781 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:56.921962 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:56.921962 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:56.921962 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:57.082496 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:57.093180 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:57.103205 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:57.106731 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c0fd7c6d-94d8-41c6-a6ce-01b6b54537c3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.200919 May 12 09:45:57.121100 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 487/969] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:56 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:57.801112 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:57.801831 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] [instance: 5697f44b-088d-48ee-89a1-ae6d09f7d47f] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:57.812367 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:57.812816 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:57.813597 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:57.814069 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:57.841304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] HTTP exception thrown: Instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f could not be found. May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Request method failure captured: May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f HTTP/1.1 May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNXqzzehcIQKFcqmQRT-s-CdxeUNUR69fyIUW1rshAFQwxaCLwRnSt2TaaAP-oXVgAVrAEYs1FUPXQ0g6Yxu2TPlFlikpMIY0Tq-9FLbzPwBkHYN6_FsFP044w_x8q_dk9f73ZdzrcJRBqUjsE928ooHMpt6p-ftP955YE3qFTsF_O8 May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: 170aaa04d8fe4170bf344d5667ae2814 May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-TestShelveInstance-443428712 May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:45:57.843169 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_170aaa04d8fe4170bf344d5667ae2814", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/170aaa04d8fe4170bf344d5667ae2814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/170aaa04d8fe4170bf344d5667ae2814"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/170aaa04d8fe4170bf344d5667ae2814"}]}] May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-TestShelveInstance-443428712 May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: 170aaa04d8fe4170bf344d5667ae2814 May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-TestShelveInstance-443428712 May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-TestShelveInstance-443428712-project May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: fde21f628031431583e085d26485451d May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-TestShelveInstance-443428712-project May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f could not be found. May 12 09:45:57.844978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '5697f44b-088d-48ee-89a1-ae6d09f7d47f'} May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f could not be found. May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:45:57.846035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f could not be found. May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f could not be found. May 12 09:45:57.848136 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:45:57.852611 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Returning 404 to user: Instance 5697f44b-088d-48ee-89a1-ae6d09f7d47f could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:45:57.853505 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a50c0da5-7095-49aa-b953-c4205d8c30a4 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f" status: 404 len: 111 microversion: 2.1 time: 0.057009 May 12 09:45:57.854094 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 483/970] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:45:57 2022] GET /compute/v2.1/servers/5697f44b-088d-48ee-89a1-ae6d09f7d47f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:45:58.082519 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5b72d221-fe01-4554-beec-9d3dc35263e0 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] Calling method '.version_select at 0x7f872b2e3dc0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:58.106790 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5b72d221-fe01-4554-beec-9d3dc35263e0 tempest-TestShelveInstance-443428712 tempest-TestShelveInstance-443428712-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1560436604" status: 202 len: 0 microversion: 2.1 time: 0.028374 May 12 09:45:58.108164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 488/971] 10.222.0.60 () {58 vars in 1253 bytes} [Thu May 12 09:45:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1560436604 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:45:58.141857 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:58.145701 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:58.169031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:58.169854 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:58.172404 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:58.175035 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:58.339640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:58.348749 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:58.351088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:58.352279 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0728f0fa-1de0-4605-abec-b9c45e1ca2ef tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.228610 May 12 09:45:58.353433 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 484/972] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:58 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:45:59.373791 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:45:59.379475 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:45:59.405281 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:59.407624 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:59.410090 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:45:59.412451 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:45:59.614943 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:59.624073 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:59.625588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:45:59.626817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c0c103ec-b1a1-4fe8-9d0d-d215d1f9a4a1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.258317 May 12 09:45:59.627643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 489/973] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:45:59 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:00.650131 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:00.650740 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:00.670889 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:00.671268 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:00.672085 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:00.672677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:01.085790 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:01.106161 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:01.108196 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:01.141226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7379c601-c396-453f-9cc8-446a4ad5ac79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.494495 May 12 09:46:01.152617 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 485/974] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:00 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:02.168383 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:02.168997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:02.175568 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:02.176027 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:02.176801 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:02.177262 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:02.412910 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:02.432999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:02.435164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:02.441260 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4947d42c-79a9-49b1-a0c8-b71ec170b882 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1741 microversion: 2.20 time: 0.276831 May 12 09:46:02.451298 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 490/975] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:02 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1741 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:03.463168 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:03.463798 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:03.470636 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:03.471090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:03.472373 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:03.472829 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:03.619006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:03.626687 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:03.628265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:03.629418 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e718b74d-f2f7-4eeb-944e-b9296faaafcc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1723 microversion: 2.20 time: 0.170300 May 12 09:46:03.629989 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 486/976] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:03 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:04.649097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:04.649709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:04.656696 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:04.657154 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:04.658152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:04.658594 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:04.812521 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:04.821721 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:04.823255 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:04.824444 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-db90970a-4ab4-41cd-9bd9-43134068da17 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1723 microversion: 2.20 time: 0.179301 May 12 09:46:04.825016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 491/977] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:04 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:05.843010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:05.843705 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:05.851929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:05.852702 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:05.853714 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:05.854237 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:06.038178 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:06.046853 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:06.049823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:06.051261 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d126e68d-55dd-4856-8848-1d1a460cf9ff tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1726 microversion: 2.20 time: 0.212462 May 12 09:46:06.052299 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 487/978] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:05 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1726 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:06.070154 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-62c1af78-22ea-4e24-afbf-3f793ac9ba7a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0401807-29e8-4b34-9c1c-4948d34bb4ef"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:06.071396 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-62c1af78-22ea-4e24-afbf-3f793ac9ba7a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:06.090252 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-62c1af78-22ea-4e24-afbf-3f793ac9ba7a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:06.090706 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-62c1af78-22ea-4e24-afbf-3f793ac9ba7a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:06.091495 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-62c1af78-22ea-4e24-afbf-3f793ac9ba7a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:06.091934 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-62c1af78-22ea-4e24-afbf-3f793ac9ba7a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:06.393192 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-62c1af78-22ea-4e24-afbf-3f793ac9ba7a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326990 May 12 09:46:06.398325 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 492/979] 10.222.0.60 () {62 vars in 1363 bytes} [Thu May 12 09:46:06 2022] POST /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:46:06.519901 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b894b49a-1b2d-4b43-9ad4-ecf1028c7771 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:06.520476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b894b49a-1b2d-4b43-9ad4-ecf1028c7771 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:06.526678 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b894b49a-1b2d-4b43-9ad4-ecf1028c7771 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:06.527132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b894b49a-1b2d-4b43-9ad4-ecf1028c7771 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:06.528134 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b894b49a-1b2d-4b43-9ad4-ecf1028c7771 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:06.528929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b894b49a-1b2d-4b43-9ad4-ecf1028c7771 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:06.610395 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b894b49a-1b2d-4b43-9ad4-ecf1028c7771 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/action" status: 202 len: 0 microversion: 2.20 time: 0.094223 May 12 09:46:06.611195 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 488/980] 10.222.0.60 () {62 vars in 1318 bytes} [Thu May 12 09:46:06 2022] POST /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 09:46:06.619034 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:06.619642 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:06.632138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:06.632890 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:06.634440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:06.635779 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:06.785164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:06.794123 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-d1f5c1dd-78db-40d1-8c77-2b5477415289 req-3aac24e6-76ac-49d4-a3d6-37bcce8221e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18552b7d-9ecc-4182-b0fd-726899815dcf", "name": "network-vif-unplugged", "status": "completed", "tag": "b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:06.796817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:06.798655 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:06.800224 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-447d8b00-be7e-44c5-bc19-3f8dfa7dcd69 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1752 microversion: 2.20 time: 0.184851 May 12 09:46:06.811883 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 493/981] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:06 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:06.817122 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-d1f5c1dd-78db-40d1-8c77-2b5477415289 req-3aac24e6-76ac-49d4-a3d6-37bcce8221e4 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:06.817642 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-d1f5c1dd-78db-40d1-8c77-2b5477415289 req-3aac24e6-76ac-49d4-a3d6-37bcce8221e4 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:06.832154 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.compute.server_external_events [req-d1f5c1dd-78db-40d1-8c77-2b5477415289 req-3aac24e6-76ac-49d4-a3d6-37bcce8221e4 service nova] Unable to find a host for instance 18552b7d-9ecc-4182-b0fd-726899815dcf. Dropping event network-vif-unplugged {{(pid=123509) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 12 09:46:06.833382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-d1f5c1dd-78db-40d1-8c77-2b5477415289 req-3aac24e6-76ac-49d4-a3d6-37bcce8221e4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043771 May 12 09:46:06.834553 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 489/982] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 12 09:46:07.819505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:07.820160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:07.827276 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:07.832217 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:07.833310 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:07.833767 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:08.027109 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:08.035922 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:08.037631 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:08.038948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c1315a5d-e039-4639-af89-36aa9381776c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1754 microversion: 2.20 time: 0.223993 May 12 09:46:08.039450 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 494/983] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:07 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1754 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:09.058308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:09.059560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:09.066713 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:09.067386 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:09.068560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:09.068939 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:09.210107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:09.218441 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:09.219997 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:09.221145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8d4f19ff-2cfb-44c6-9f17-d5c474a78c5d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.166760 May 12 09:46:09.222311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 490/984] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:09 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:10.240942 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:10.241683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:10.250545 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:10.254439 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:10.255311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:10.255832 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:10.432591 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:10.452980 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:10.458415 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:10.459657 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b6b3691c-b0ca-4948-abed-6591ce3818b8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.223428 May 12 09:46:10.460233 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 495/985] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:10 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:11.479759 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:11.480379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:11.490105 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:11.490876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:11.491905 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:11.494302 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:11.631514 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:11.640772 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:11.642592 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:11.643960 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-cc937768-964a-41dc-859f-869d34ae7930 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.168582 May 12 09:46:11.644664 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 491/986] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:11 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:12.539960 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-782874606", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "networks": [{"uuid": "a979ad69-574d-4551-aeb4-f162ac77a9b9"}]}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:12.591384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] validate_networks() for [('a979ad69-574d-4551-aeb4-f162ac77a9b9', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:46:12.663196 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:12.663986 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:12.670475 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:12.671039 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:12.671916 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:12.672472 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:12.861350 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:12.879728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:12.882393 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:12.884606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-af44e415-3710-4431-92d7-82b9f9baa958 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.226000 May 12 09:46:12.888238 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 492/987] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:12 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:13.078043 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:46:13.078480 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:46:13.078957 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:46:13.079372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:46:13.079789 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:46:13.089285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:13.089745 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:13.090610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:13.091054 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:13.108390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Getting quotas for project f905d25356874ac88be7ed35a624e230. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:46:13.112315 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Getting quotas for user 8427a2000ab943f6a6fa72d068efe2ac and project f905d25356874ac88be7ed35a624e230. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:46:13.123156 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:46:13.125454 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:46:13.172479 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e4dcdcaf-64bc-4c6e-aa49-b873987b58c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636255 May 12 09:46:13.173301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 496/988] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:46:13.183534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d79f1763-ea96-46f0-9834-34e9c0eb9847 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:13.184154 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d79f1763-ea96-46f0-9834-34e9c0eb9847 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:13.245782 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d79f1763-ea96-46f0-9834-34e9c0eb9847 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:13.253882 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d79f1763-ea96-46f0-9834-34e9c0eb9847 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1213 microversion: 2.1 time: 0.073573 May 12 09:46:13.255008 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 493/989] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:13 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:13.908032 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:13.908587 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:13.916354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:13.916803 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:13.917572 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:13.918031 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:14.053135 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:14.061633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:14.063200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:14.064362 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1d5846fb-3dcf-4761-9fb8-8d82884ceb35 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.160858 May 12 09:46:14.064918 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 497/990] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:13 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:14.271408 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-36b77edf-24b8-444d-bff4-0abc2ff523c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:14.272209 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-36b77edf-24b8-444d-bff4-0abc2ff523c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:14.281513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-36b77edf-24b8-444d-bff4-0abc2ff523c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:14.281998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-36b77edf-24b8-444d-bff4-0abc2ff523c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:14.282811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-36b77edf-24b8-444d-bff4-0abc2ff523c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:14.283246 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-36b77edf-24b8-444d-bff4-0abc2ff523c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:14.346177 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-36b77edf-24b8-444d-bff4-0abc2ff523c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:14.355549 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-36b77edf-24b8-444d-bff4-0abc2ff523c5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.087937 May 12 09:46:14.356578 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 494/991] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:14 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:15.083141 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:15.083748 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:15.091824 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:15.092542 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:15.093541 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:15.095270 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:15.234311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:15.243636 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:15.245266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:15.246609 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-67cb32d5-46ce-40ea-98c9-d03f8dd49376 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.167878 May 12 09:46:15.247277 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 498/992] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:15 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:15.373434 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-632dc9a6-21a6-457d-a77f-24bcd9bc2172 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:15.374024 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-632dc9a6-21a6-457d-a77f-24bcd9bc2172 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:15.380198 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-632dc9a6-21a6-457d-a77f-24bcd9bc2172 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:15.380644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-632dc9a6-21a6-457d-a77f-24bcd9bc2172 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:15.381415 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-632dc9a6-21a6-457d-a77f-24bcd9bc2172 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:15.381844 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-632dc9a6-21a6-457d-a77f-24bcd9bc2172 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:15.447817 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-632dc9a6-21a6-457d-a77f-24bcd9bc2172 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:15.455210 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-632dc9a6-21a6-457d-a77f-24bcd9bc2172 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.085716 May 12 09:46:15.455905 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 495/993] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:15 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:16.265254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:16.266035 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:16.272847 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:16.273297 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:16.274103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:16.274547 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:16.408559 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:16.417678 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:16.419292 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:16.420495 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-88e95019-8fc7-45af-8e8d-187dea1bfc4b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.159628 May 12 09:46:16.421058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 499/994] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:16 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:16.472562 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-19e47502-0a03-4c73-aab1-9b9f79000b89 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:16.473174 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-19e47502-0a03-4c73-aab1-9b9f79000b89 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:16.480090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-19e47502-0a03-4c73-aab1-9b9f79000b89 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:16.480544 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-19e47502-0a03-4c73-aab1-9b9f79000b89 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:16.481323 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-19e47502-0a03-4c73-aab1-9b9f79000b89 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:16.481763 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-19e47502-0a03-4c73-aab1-9b9f79000b89 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:16.544641 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-19e47502-0a03-4c73-aab1-9b9f79000b89 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:16.552117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-19e47502-0a03-4c73-aab1-9b9f79000b89 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.083980 May 12 09:46:16.554148 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 496/995] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:16 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:17.438877 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:17.439500 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:17.446749 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:17.447311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:17.448185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:17.448669 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:17.570818 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2fd3f4da-2288-4f19-a18c-5d7599742ac7 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:17.571606 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2fd3f4da-2288-4f19-a18c-5d7599742ac7 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:17.578215 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2fd3f4da-2288-4f19-a18c-5d7599742ac7 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:17.578678 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2fd3f4da-2288-4f19-a18c-5d7599742ac7 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:17.579452 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2fd3f4da-2288-4f19-a18c-5d7599742ac7 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:17.579900 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2fd3f4da-2288-4f19-a18c-5d7599742ac7 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:17.591108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:17.600306 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:17.601850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:17.603049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-049fa78e-3edd-42bd-a8b9-8a78dc03aaf6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.168393 May 12 09:46:17.603670 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 500/996] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:17 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:17.645386 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2fd3f4da-2288-4f19-a18c-5d7599742ac7 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:17.653946 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2fd3f4da-2288-4f19-a18c-5d7599742ac7 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.087099 May 12 09:46:17.654511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 497/997] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:17 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:46:18.621827 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:18.622499 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:18.629484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:18.633163 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:18.634092 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:18.634561 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:18.672591 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5247b6fd-a9da-4316-a3a3-5b751f52dbb8 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:18.673693 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5247b6fd-a9da-4316-a3a3-5b751f52dbb8 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:18.680966 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5247b6fd-a9da-4316-a3a3-5b751f52dbb8 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:18.681729 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5247b6fd-a9da-4316-a3a3-5b751f52dbb8 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:18.682772 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5247b6fd-a9da-4316-a3a3-5b751f52dbb8 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:18.683359 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5247b6fd-a9da-4316-a3a3-5b751f52dbb8 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:18.778651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5247b6fd-a9da-4316-a3a3-5b751f52dbb8 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:18.786711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5247b6fd-a9da-4316-a3a3-5b751f52dbb8 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.119894 May 12 09:46:18.787584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 498/998] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:18 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:46:18.807077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:18.816252 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:18.817923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:18.819230 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4eaa6bd6-1479-416e-8f18-1012f4ba22ed tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.201269 May 12 09:46:18.819974 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 501/999] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:18 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:19.803007 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a0b1581a-2f52-4cd6-ab1b-8bfecc93e058 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:19.803754 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a0b1581a-2f52-4cd6-ab1b-8bfecc93e058 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:19.811062 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a0b1581a-2f52-4cd6-ab1b-8bfecc93e058 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:19.811523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a0b1581a-2f52-4cd6-ab1b-8bfecc93e058 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:19.812325 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a0b1581a-2f52-4cd6-ab1b-8bfecc93e058 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:19.812790 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a0b1581a-2f52-4cd6-ab1b-8bfecc93e058 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:19.838291 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:19.838862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:19.845145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:19.845596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:19.846385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:19.846899 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:19.872746 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a0b1581a-2f52-4cd6-ab1b-8bfecc93e058 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:19.880823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a0b1581a-2f52-4cd6-ab1b-8bfecc93e058 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.081761 May 12 09:46:19.881391 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 499/1000] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:19 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:19.974327 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:19.982592 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:19.984102 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:19.985267 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c6f83dde-ede6-4a18-8658-0ed1d38cb0d4 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.150880 May 12 09:46:19.985835 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 502/1001] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:19 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:46:20.898631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-72c5db10-9b4d-4328-bcba-bf831c7d0199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:20.899206 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-72c5db10-9b4d-4328-bcba-bf831c7d0199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:20.905521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-72c5db10-9b4d-4328-bcba-bf831c7d0199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:20.905993 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-72c5db10-9b4d-4328-bcba-bf831c7d0199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:20.906754 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-72c5db10-9b4d-4328-bcba-bf831c7d0199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:20.907182 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-72c5db10-9b4d-4328-bcba-bf831c7d0199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:20.970400 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-72c5db10-9b4d-4328-bcba-bf831c7d0199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:20.978114 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-72c5db10-9b4d-4328-bcba-bf831c7d0199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.083447 May 12 09:46:20.978652 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 500/1002] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:20 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:21.003188 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:21.003919 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:21.010356 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:21.010788 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:21.011813 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:21.012254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:21.135808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:21.144722 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:21.146278 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:21.147444 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-eab3e39f-e776-4b69-ba54-1f085c0004c6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.148139 May 12 09:46:21.148006 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 503/1003] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:20 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:21.346690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b996ced9-ab1d-403c-9a6d-076714ffa703 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:21.347185 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b996ced9-ab1d-403c-9a6d-076714ffa703 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:21.352949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b996ced9-ab1d-403c-9a6d-076714ffa703 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:21.353396 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b996ced9-ab1d-403c-9a6d-076714ffa703 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:21.354189 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b996ced9-ab1d-403c-9a6d-076714ffa703 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:21.354627 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b996ced9-ab1d-403c-9a6d-076714ffa703 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:21.376344 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b996ced9-ab1d-403c-9a6d-076714ffa703 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/ips" status: 200 len: 151 microversion: 2.1 time: 0.188091 May 12 09:46:21.376875 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 501/1004] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:46:21 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/ips => generated 151 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:21.994917 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c7895ac1-8a98-413c-9879-4ca94a77bcb0 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:21.995523 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c7895ac1-8a98-413c-9879-4ca94a77bcb0 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:22.001371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c7895ac1-8a98-413c-9879-4ca94a77bcb0 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:22.001824 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c7895ac1-8a98-413c-9879-4ca94a77bcb0 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:22.002616 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c7895ac1-8a98-413c-9879-4ca94a77bcb0 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:22.003055 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c7895ac1-8a98-413c-9879-4ca94a77bcb0 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:22.063833 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c7895ac1-8a98-413c-9879-4ca94a77bcb0 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:22.071011 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c7895ac1-8a98-413c-9879-4ca94a77bcb0 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.079951 May 12 09:46:22.071569 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 504/1005] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:21 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:22.165958 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:22.166500 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:22.172739 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:22.173183 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:22.173967 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:22.174398 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:22.299209 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:22.307808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:22.309322 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:22.310490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0a3f6d69-494e-4f6d-8842-b62ce310efbe tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.148476 May 12 09:46:22.311394 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 502/1006] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:22 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:23.088195 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-99e6efdb-0280-4d95-a583-3e373cdeab0c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:23.088808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-99e6efdb-0280-4d95-a583-3e373cdeab0c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:23.095162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-99e6efdb-0280-4d95-a583-3e373cdeab0c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:23.095620 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-99e6efdb-0280-4d95-a583-3e373cdeab0c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:23.096397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-99e6efdb-0280-4d95-a583-3e373cdeab0c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:23.096840 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-99e6efdb-0280-4d95-a583-3e373cdeab0c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:23.160473 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-99e6efdb-0280-4d95-a583-3e373cdeab0c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:23.168851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-99e6efdb-0280-4d95-a583-3e373cdeab0c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.084589 May 12 09:46:23.169425 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 505/1007] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:23 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:23.328429 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:23.328957 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:23.335288 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:23.335740 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:23.336501 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:23.336941 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:23.460880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:23.468853 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:23.470363 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:23.471496 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c03a4856-dd6e-453f-bd24-cbe8f890b3e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.146996 May 12 09:46:23.472551 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 503/1008] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:23 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:23.733780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e342260b-2a81-406b-bcab-0eb001017b3b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f943af19-2f94-4531-b457-0ee96c421c77"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:23.734968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e342260b-2a81-406b-bcab-0eb001017b3b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:23.740930 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e342260b-2a81-406b-bcab-0eb001017b3b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:23.741373 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e342260b-2a81-406b-bcab-0eb001017b3b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:23.742153 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e342260b-2a81-406b-bcab-0eb001017b3b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:23.742585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e342260b-2a81-406b-bcab-0eb001017b3b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:24.185589 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e1e013c8-1497-4217-8b98-bb8b969ac962 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:24.186221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e1e013c8-1497-4217-8b98-bb8b969ac962 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:24.192652 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e1e013c8-1497-4217-8b98-bb8b969ac962 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:24.193101 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e1e013c8-1497-4217-8b98-bb8b969ac962 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:24.193858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e1e013c8-1497-4217-8b98-bb8b969ac962 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:24.194322 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e1e013c8-1497-4217-8b98-bb8b969ac962 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:24.258372 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e1e013c8-1497-4217-8b98-bb8b969ac962 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:24.265857 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e1e013c8-1497-4217-8b98-bb8b969ac962 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1217 microversion: 2.1 time: 0.084089 May 12 09:46:24.266431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 504/1009] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:24 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:46:24.490131 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:24.490836 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:24.497088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:24.497548 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:24.498350 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:24.498794 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:24.638543 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:24.647687 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:24.649608 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:24.651032 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-144b99a8-5649-4871-8ce2-b1788354070c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.164876 May 12 09:46:24.651760 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 505/1010] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:24 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:46:24.716245 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e342260b-2a81-406b-bcab-0eb001017b3b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "POST /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986228 May 12 09:46:24.721629 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 506/1011] 10.222.0.60 () {60 vars in 1322 bytes} [Thu May 12 09:46:23 2022] POST /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:25.283184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6c2544b7-79ac-43a5-aef2-2af017e6fa05 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:25.284789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6c2544b7-79ac-43a5-aef2-2af017e6fa05 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:25.290568 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6c2544b7-79ac-43a5-aef2-2af017e6fa05 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:25.291279 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6c2544b7-79ac-43a5-aef2-2af017e6fa05 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:25.291795 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6c2544b7-79ac-43a5-aef2-2af017e6fa05 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:25.292534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6c2544b7-79ac-43a5-aef2-2af017e6fa05 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:25.354653 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6c2544b7-79ac-43a5-aef2-2af017e6fa05 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:25.361808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6c2544b7-79ac-43a5-aef2-2af017e6fa05 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1271 microversion: 2.1 time: 0.082600 May 12 09:46:25.362469 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 506/1012] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:25 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:25.669560 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:25.670422 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:25.677484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:25.677968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:25.678746 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:25.679185 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:25.816280 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:25.824867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:25.826417 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:25.827588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e3a8f4b4-37ab-4143-8968-e27935d35207 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.162863 May 12 09:46:25.828145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 507/1013] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:25 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:26.380250 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f5c92584-ff7f-4709-ae25-9d8e9799e7b2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:26.381032 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f5c92584-ff7f-4709-ae25-9d8e9799e7b2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:26.388002 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f5c92584-ff7f-4709-ae25-9d8e9799e7b2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:26.388430 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f5c92584-ff7f-4709-ae25-9d8e9799e7b2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:26.389199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f5c92584-ff7f-4709-ae25-9d8e9799e7b2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:26.389633 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f5c92584-ff7f-4709-ae25-9d8e9799e7b2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:26.442473 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-d7e6f16f-8901-4e63-addc-1d8d2dd292cd req-5f9b3bb6-ebe8-4927-b1a0-803614a2be14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c5ecc5-d507-4ec5-8d70-c08225968aa0", "tag": "0b0e76dc-66e5-4455-bb32-2661005e59fd"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:26.452606 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-d7e6f16f-8901-4e63-addc-1d8d2dd292cd req-5f9b3bb6-ebe8-4927-b1a0-803614a2be14 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:26.453480 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-d7e6f16f-8901-4e63-addc-1d8d2dd292cd req-5f9b3bb6-ebe8-4927-b1a0-803614a2be14 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:26.467735 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-d7e6f16f-8901-4e63-addc-1d8d2dd292cd req-5f9b3bb6-ebe8-4927-b1a0-803614a2be14 service nova] Creating event network-changed:0b0e76dc-66e5-4455-bb32-2661005e59fd for instance 14c5ecc5-d507-4ec5-8d70-c08225968aa0 on hv-cinder-83769 May 12 09:46:26.473441 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-d7e6f16f-8901-4e63-addc-1d8d2dd292cd req-5f9b3bb6-ebe8-4927-b1a0-803614a2be14 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035625 May 12 09:46:26.474162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 508/1014] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:26.528961 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f5c92584-ff7f-4709-ae25-9d8e9799e7b2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:26.537401 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f5c92584-ff7f-4709-ae25-9d8e9799e7b2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1313 microversion: 2.1 time: 0.161609 May 12 09:46:26.538004 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 507/1015] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:26 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:26.845861 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:26.846746 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:26.853232 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:26.853775 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:26.854684 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:26.855227 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:26.989151 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:26.997331 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:26.998873 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:27.000029 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-37b9dd4f-0623-4919-b09d-2af1186200e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.158407 May 12 09:46:27.000586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 509/1016] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:26 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:27.554637 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e2605b84-1520-4cbf-9ce0-e37092379f4e tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:27.555242 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e2605b84-1520-4cbf-9ce0-e37092379f4e tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:27.561434 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2605b84-1520-4cbf-9ce0-e37092379f4e tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:27.561880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2605b84-1520-4cbf-9ce0-e37092379f4e tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:27.562666 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2605b84-1520-4cbf-9ce0-e37092379f4e tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:27.563097 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e2605b84-1520-4cbf-9ce0-e37092379f4e tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:27.689658 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e2605b84-1520-4cbf-9ce0-e37092379f4e tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:27.697360 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e2605b84-1520-4cbf-9ce0-e37092379f4e tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1313 microversion: 2.1 time: 0.146613 May 12 09:46:27.697925 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 508/1017] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:27 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:28.018521 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:28.019135 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:28.025401 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:28.025856 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:28.026667 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:28.027107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:28.151618 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:28.160279 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:28.161777 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:28.162965 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-90e6fbef-7f4a-4a0f-9b6f-b576caca3d67 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.148335 May 12 09:46:28.163527 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 510/1018] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:28 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:28.713395 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c8db106f-db0d-4777-9e59-c40242b5025f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:28.714043 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c8db106f-db0d-4777-9e59-c40242b5025f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:28.720320 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8db106f-db0d-4777-9e59-c40242b5025f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:28.720768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8db106f-db0d-4777-9e59-c40242b5025f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:28.722050 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8db106f-db0d-4777-9e59-c40242b5025f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:28.722490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8db106f-db0d-4777-9e59-c40242b5025f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:28.848209 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c8db106f-db0d-4777-9e59-c40242b5025f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:28.855286 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c8db106f-db0d-4777-9e59-c40242b5025f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1313 microversion: 2.1 time: 0.145764 May 12 09:46:28.855848 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 509/1019] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:28 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:29.181016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:29.181613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:29.187888 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:29.188368 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:29.189124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:29.189554 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:29.316536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:29.324879 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:29.326454 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:29.327608 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-72fc03f0-c89a-4854-8539-570c19560093 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.150546 May 12 09:46:29.328163 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 511/1020] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:29 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:29.872566 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c1964e19-85b7-4ddd-bcb2-cb4ebf351614 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:29.873160 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c1964e19-85b7-4ddd-bcb2-cb4ebf351614 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:29.879677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c1964e19-85b7-4ddd-bcb2-cb4ebf351614 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:29.880126 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c1964e19-85b7-4ddd-bcb2-cb4ebf351614 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:29.880886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c1964e19-85b7-4ddd-bcb2-cb4ebf351614 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:29.881320 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c1964e19-85b7-4ddd-bcb2-cb4ebf351614 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:30.007622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c1964e19-85b7-4ddd-bcb2-cb4ebf351614 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:30.015098 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c1964e19-85b7-4ddd-bcb2-cb4ebf351614 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1313 microversion: 2.1 time: 0.146370 May 12 09:46:30.015670 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 510/1021] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:29 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:30.345789 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:30.346362 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:30.353170 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:30.353615 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:30.354406 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:30.354842 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:30.476876 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:30.485041 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:30.486563 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:30.488324 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-393f5734-a9c2-44c4-b316-70f84a331a05 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.146566 May 12 09:46:30.488920 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 512/1022] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:30 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:31.032325 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-34723cfb-6e6d-4439-8f31-31ca57a60199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:31.032932 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-34723cfb-6e6d-4439-8f31-31ca57a60199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:31.039332 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-34723cfb-6e6d-4439-8f31-31ca57a60199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:31.039795 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-34723cfb-6e6d-4439-8f31-31ca57a60199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:31.040562 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-34723cfb-6e6d-4439-8f31-31ca57a60199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:31.041005 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-34723cfb-6e6d-4439-8f31-31ca57a60199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:31.166253 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-34723cfb-6e6d-4439-8f31-31ca57a60199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:31.173419 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-34723cfb-6e6d-4439-8f31-31ca57a60199 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1313 microversion: 2.1 time: 0.144956 May 12 09:46:31.174001 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 511/1023] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:31 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:31.506418 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:31.507030 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:31.513494 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:31.513989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:31.514769 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:31.515208 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:31.643367 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:31.651593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:31.653095 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:31.654292 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a927e7f9-32b8-41ee-baf9-ca5d35601f9d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.152385 May 12 09:46:31.654850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 513/1024] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:31 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:32.189968 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-20e5a2b8-a3f8-4e37-91ff-8eca73e7ecd5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:32.191137 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-20e5a2b8-a3f8-4e37-91ff-8eca73e7ecd5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:32.197281 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20e5a2b8-a3f8-4e37-91ff-8eca73e7ecd5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:32.197730 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20e5a2b8-a3f8-4e37-91ff-8eca73e7ecd5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:32.198530 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20e5a2b8-a3f8-4e37-91ff-8eca73e7ecd5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:32.198964 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-20e5a2b8-a3f8-4e37-91ff-8eca73e7ecd5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:32.329855 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-20e5a2b8-a3f8-4e37-91ff-8eca73e7ecd5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:32.337460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-20e5a2b8-a3f8-4e37-91ff-8eca73e7ecd5 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1313 microversion: 2.1 time: 0.151245 May 12 09:46:32.338049 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 512/1025] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:32 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:32.672505 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:32.673114 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:32.679523 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:32.679978 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:32.680748 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:32.681189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:32.809321 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:32.818082 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:32.819588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:32.820743 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-216ca04d-bf52-46bc-937f-8a0c17e07f86 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.152168 May 12 09:46:32.821629 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 514/1026] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:32 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:33.024120 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-d43ae9e7-7b30-4ae8-9e51-dfc10ba9838f req-ee9f4cfc-967f-481a-be64-aaceae9533a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c5ecc5-d507-4ec5-8d70-c08225968aa0", "name": "network-vif-plugged", "status": "completed", "tag": "0b0e76dc-66e5-4455-bb32-2661005e59fd"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:33.031917 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-d43ae9e7-7b30-4ae8-9e51-dfc10ba9838f req-ee9f4cfc-967f-481a-be64-aaceae9533a1 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:33.032357 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-d43ae9e7-7b30-4ae8-9e51-dfc10ba9838f req-ee9f4cfc-967f-481a-be64-aaceae9533a1 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:33.046636 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-d43ae9e7-7b30-4ae8-9e51-dfc10ba9838f req-ee9f4cfc-967f-481a-be64-aaceae9533a1 service nova] Creating event network-vif-plugged:0b0e76dc-66e5-4455-bb32-2661005e59fd for instance 14c5ecc5-d507-4ec5-8d70-c08225968aa0 on hv-cinder-83769 May 12 09:46:33.053456 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-d43ae9e7-7b30-4ae8-9e51-dfc10ba9838f req-ee9f4cfc-967f-481a-be64-aaceae9533a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032776 May 12 09:46:33.054084 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 513/1027] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:33.353722 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-15500801-dd66-45bd-a6c4-5bcd678ffffd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:33.354384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-15500801-dd66-45bd-a6c4-5bcd678ffffd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:33.356631 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4e279952-0c9c-4e33-a281-b101fef37d89 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:33.357239 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4e279952-0c9c-4e33-a281-b101fef37d89 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:33.360418 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-15500801-dd66-45bd-a6c4-5bcd678ffffd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:33.360862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-15500801-dd66-45bd-a6c4-5bcd678ffffd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:33.361619 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-15500801-dd66-45bd-a6c4-5bcd678ffffd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:33.362113 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-15500801-dd66-45bd-a6c4-5bcd678ffffd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:33.363677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e279952-0c9c-4e33-a281-b101fef37d89 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:33.364132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e279952-0c9c-4e33-a281-b101fef37d89 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:33.364902 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e279952-0c9c-4e33-a281-b101fef37d89 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:33.365337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e279952-0c9c-4e33-a281-b101fef37d89 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:33.444037 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-4e279952-0c9c-4e33-a281-b101fef37d89 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lazy-loading 'services' on Instance uuid afe60f94-7d27-4924-8df7-0a49d9455ade {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:46:33.489603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-15500801-dd66-45bd-a6c4-5bcd678ffffd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:33.498046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-15500801-dd66-45bd-a6c4-5bcd678ffffd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1313 microversion: 2.1 time: 0.148080 May 12 09:46:33.499370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 515/1028] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:33 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:33.517223 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4e279952-0c9c-4e33-a281-b101fef37d89 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments/f943af19-2f94-4531-b457-0ee96c421c77" status: 202 len: 0 microversion: 2.1 time: 0.164734 May 12 09:46:33.518217 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 514/1029] 10.222.0.60 () {58 vars in 1415 bytes} [Thu May 12 09:46:33 2022] DELETE /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments/f943af19-2f94-4531-b457-0ee96c421c77 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 09:46:33.527121 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b8203a1e-78e8-45f4-9d79-8dd882b98e18 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:33.528184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b8203a1e-78e8-45f4-9d79-8dd882b98e18 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:33.534131 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8203a1e-78e8-45f4-9d79-8dd882b98e18 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:33.534648 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8203a1e-78e8-45f4-9d79-8dd882b98e18 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:33.535478 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8203a1e-78e8-45f4-9d79-8dd882b98e18 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:33.535983 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b8203a1e-78e8-45f4-9d79-8dd882b98e18 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:33.567130 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b8203a1e-78e8-45f4-9d79-8dd882b98e18 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 May 12 09:46:33.567904 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 516/1030] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:46:33 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:46:33.839380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:33.839985 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:33.846108 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:33.846574 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:33.847331 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:33.847766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:33.971112 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:33.979624 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:33.981348 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:33.982513 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-67085e1f-ebc7-415b-b325-eff223a4451d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.147472 May 12 09:46:33.983062 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 515/1031] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:33 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:34.516030 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b80d4e89-9dcf-45f6-8861-0af08b2bdc3a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:34.516652 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b80d4e89-9dcf-45f6-8861-0af08b2bdc3a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:34.523386 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b80d4e89-9dcf-45f6-8861-0af08b2bdc3a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:34.523837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b80d4e89-9dcf-45f6-8861-0af08b2bdc3a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:34.524599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b80d4e89-9dcf-45f6-8861-0af08b2bdc3a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:34.525034 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b80d4e89-9dcf-45f6-8861-0af08b2bdc3a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:34.578577 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-baf4c1e8-0b0e-433e-bb80-df263369905e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:34.579498 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-baf4c1e8-0b0e-433e-bb80-df263369905e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:34.586277 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-baf4c1e8-0b0e-433e-bb80-df263369905e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:34.586728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-baf4c1e8-0b0e-433e-bb80-df263369905e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:34.587494 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-baf4c1e8-0b0e-433e-bb80-df263369905e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:34.587930 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-baf4c1e8-0b0e-433e-bb80-df263369905e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:34.616898 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-baf4c1e8-0b0e-433e-bb80-df263369905e tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042075 May 12 09:46:34.617385 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 516/1032] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:46:34 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:46:34.652830 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b80d4e89-9dcf-45f6-8861-0af08b2bdc3a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:34.660172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b80d4e89-9dcf-45f6-8861-0af08b2bdc3a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1313 microversion: 2.1 time: 0.148284 May 12 09:46:34.660741 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 517/1033] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:34 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:35.000651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:35.001242 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:35.007709 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:35.008271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:35.009272 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:35.009733 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:35.077794 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-9939283e-3a5b-4317-b53f-0a57d5cb3178 req-c85c33f0-4623-455e-ade7-011f5f11afb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18552b7d-9ecc-4182-b0fd-726899815dcf", "name": "network-vif-plugged", "status": "completed", "tag": "b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:35.086154 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-9939283e-3a5b-4317-b53f-0a57d5cb3178 req-c85c33f0-4623-455e-ade7-011f5f11afb1 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:35.086665 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-9939283e-3a5b-4317-b53f-0a57d5cb3178 req-c85c33f0-4623-455e-ade7-011f5f11afb1 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:35.100939 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-9939283e-3a5b-4317-b53f-0a57d5cb3178 req-c85c33f0-4623-455e-ade7-011f5f11afb1 service nova] Creating event network-vif-plugged:b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b for instance 18552b7d-9ecc-4182-b0fd-726899815dcf on hv-cinder-83769 May 12 09:46:35.107246 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-9939283e-3a5b-4317-b53f-0a57d5cb3178 req-c85c33f0-4623-455e-ade7-011f5f11afb1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 May 12 09:46:35.107893 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 518/1034] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:46:35.140930 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:35.149749 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:35.151199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:35.152338 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0eb686a6-083f-4776-8d7c-1abc0de6e93f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.155639 May 12 09:46:35.152892 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 517/1035] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:34 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:35.629498 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-28c0e926-8a66-4673-8dd1-61b78d74a583 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:35.630541 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-28c0e926-8a66-4673-8dd1-61b78d74a583 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:35.636691 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-28c0e926-8a66-4673-8dd1-61b78d74a583 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:35.637389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-28c0e926-8a66-4673-8dd1-61b78d74a583 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:35.638199 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-28c0e926-8a66-4673-8dd1-61b78d74a583 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:35.638640 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-28c0e926-8a66-4673-8dd1-61b78d74a583 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:35.666328 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-28c0e926-8a66-4673-8dd1-61b78d74a583 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042222 May 12 09:46:35.666899 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 519/1036] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:46:35 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:35.676880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2ca81cc3-6c04-4a74-865b-7cdd9cb823f1 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:35.677497 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2ca81cc3-6c04-4a74-865b-7cdd9cb823f1 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:35.683809 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ca81cc3-6c04-4a74-865b-7cdd9cb823f1 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:35.684273 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ca81cc3-6c04-4a74-865b-7cdd9cb823f1 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:35.685049 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ca81cc3-6c04-4a74-865b-7cdd9cb823f1 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:35.685515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ca81cc3-6c04-4a74-865b-7cdd9cb823f1 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:35.812382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2ca81cc3-6c04-4a74-865b-7cdd9cb823f1 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:35.820545 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2ca81cc3-6c04-4a74-865b-7cdd9cb823f1 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1496 microversion: 2.1 time: 0.147926 May 12 09:46:35.821117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 518/1037] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:35 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1496 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:36.170266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:36.170874 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:36.177340 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.177791 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.178576 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.179013 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.308093 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:36.317042 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:36.318688 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:36.320071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8a62cebb-3a45-443a-89c5-601c9c259061 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.153679 May 12 09:46:36.320730 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 520/1038] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:36 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:36.343838 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-17f2e7cd-e777-4861-9781-cb42732193e2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:36.344332 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-17f2e7cd-e777-4861-9781-cb42732193e2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:36.350184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17f2e7cd-e777-4861-9781-cb42732193e2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.350633 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17f2e7cd-e777-4861-9781-cb42732193e2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.351391 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17f2e7cd-e777-4861-9781-cb42732193e2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.351825 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-17f2e7cd-e777-4861-9781-cb42732193e2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.375705 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-17f2e7cd-e777-4861-9781-cb42732193e2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Going to try to terminate instance {{(pid=123509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:46:36.446854 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-17f2e7cd-e777-4861-9781-cb42732193e2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "DELETE /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 204 len: 0 microversion: 2.1 time: 0.106629 May 12 09:46:36.447491 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 519/1039] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:46:36 2022] DELETE /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:46:36.456020 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2fdf4a7c-ae23-47aa-9351-de60a443c722 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:36.456721 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2fdf4a7c-ae23-47aa-9351-de60a443c722 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:36.463870 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fdf4a7c-ae23-47aa-9351-de60a443c722 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.464334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fdf4a7c-ae23-47aa-9351-de60a443c722 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.465120 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fdf4a7c-ae23-47aa-9351-de60a443c722 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.465564 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fdf4a7c-ae23-47aa-9351-de60a443c722 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.593373 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2fdf4a7c-ae23-47aa-9351-de60a443c722 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:36.600657 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2fdf4a7c-ae23-47aa-9351-de60a443c722 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1502 microversion: 2.1 time: 0.148783 May 12 09:46:36.601223 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 521/1040] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:36 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:36.679276 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e54938a0-05f9-46e7-acbb-68f3a23b1331 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:36.680473 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e54938a0-05f9-46e7-acbb-68f3a23b1331 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:36.686672 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e54938a0-05f9-46e7-acbb-68f3a23b1331 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.687117 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e54938a0-05f9-46e7-acbb-68f3a23b1331 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.687902 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e54938a0-05f9-46e7-acbb-68f3a23b1331 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.688327 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e54938a0-05f9-46e7-acbb-68f3a23b1331 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.718557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e54938a0-05f9-46e7-acbb-68f3a23b1331 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044450 May 12 09:46:36.719231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 520/1041] 10.222.0.60 () {58 vars in 1301 bytes} [Thu May 12 09:46:36 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 09:46:36.775177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-daf603d0-f2dd-4bc9-94ed-b5e268901a73 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:36.775710 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-daf603d0-f2dd-4bc9-94ed-b5e268901a73 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:36.781995 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-daf603d0-f2dd-4bc9-94ed-b5e268901a73 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.782446 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-daf603d0-f2dd-4bc9-94ed-b5e268901a73 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.783210 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-daf603d0-f2dd-4bc9-94ed-b5e268901a73 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.783649 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-daf603d0-f2dd-4bc9-94ed-b5e268901a73 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.809131 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-daf603d0-f2dd-4bc9-94ed-b5e268901a73 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:46:36.880669 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-daf603d0-f2dd-4bc9-94ed-b5e268901a73 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 204 len: 0 microversion: 2.1 time: 0.108962 May 12 09:46:36.881246 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 522/1042] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:46:36 2022] DELETE /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:46:36.889560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ff15f5a2-92ef-4977-bab9-32959142b1a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:36.890201 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ff15f5a2-92ef-4977-bab9-32959142b1a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:36.896324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ff15f5a2-92ef-4977-bab9-32959142b1a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.896768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ff15f5a2-92ef-4977-bab9-32959142b1a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:36.897517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ff15f5a2-92ef-4977-bab9-32959142b1a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:36.897971 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ff15f5a2-92ef-4977-bab9-32959142b1a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:37.292286 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ff15f5a2-92ef-4977-bab9-32959142b1a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:37.299575 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ff15f5a2-92ef-4977-bab9-32959142b1a2 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1682 microversion: 2.1 time: 0.414044 May 12 09:46:37.300132 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 521/1043] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:36 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1682 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:37.340124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:37.340820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:37.347418 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:37.347872 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:37.348641 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:37.349077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:37.474931 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:37.483189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:37.484684 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:37.485841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ee1adcce-9cef-4828-b2b9-e5bd24b35977 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.150008 May 12 09:46:37.486437 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 523/1044] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:37 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:37.618340 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-18c0e7d0-0401-411b-a2ff-013f323ffe8a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:37.618940 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-18c0e7d0-0401-411b-a2ff-013f323ffe8a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:37.624696 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-18c0e7d0-0401-411b-a2ff-013f323ffe8a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:37.625140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-18c0e7d0-0401-411b-a2ff-013f323ffe8a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:37.625915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-18c0e7d0-0401-411b-a2ff-013f323ffe8a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:37.626355 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-18c0e7d0-0401-411b-a2ff-013f323ffe8a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:37.753553 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-18c0e7d0-0401-411b-a2ff-013f323ffe8a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:37.760809 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-18c0e7d0-0401-411b-a2ff-013f323ffe8a tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1502 microversion: 2.1 time: 0.146371 May 12 09:46:37.761377 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 522/1045] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:37 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:38.316439 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5f426633-98fb-452f-8fe3-ab92384bfd09 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:38.317049 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5f426633-98fb-452f-8fe3-ab92384bfd09 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:38.323405 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f426633-98fb-452f-8fe3-ab92384bfd09 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:38.323859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f426633-98fb-452f-8fe3-ab92384bfd09 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:38.324623 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f426633-98fb-452f-8fe3-ab92384bfd09 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:38.325059 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5f426633-98fb-452f-8fe3-ab92384bfd09 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:38.447286 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5f426633-98fb-452f-8fe3-ab92384bfd09 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:38.454487 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5f426633-98fb-452f-8fe3-ab92384bfd09 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1682 microversion: 2.1 time: 0.142418 May 12 09:46:38.455061 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 524/1046] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:38 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1682 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:38.505583 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:38.506214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:38.512396 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:38.512847 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:38.513598 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:38.514072 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:38.642242 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:38.650405 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:38.651817 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:38.652950 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-228e5215-4731-47d2-99d2-2f63ebe2f3f5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.151724 May 12 09:46:38.653497 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 523/1047] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:38 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:38.778539 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c1319d81-086a-4155-b72b-f96106ac869f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:38.779165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c1319d81-086a-4155-b72b-f96106ac869f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:38.785143 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1319d81-086a-4155-b72b-f96106ac869f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:38.785581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1319d81-086a-4155-b72b-f96106ac869f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:38.786358 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1319d81-086a-4155-b72b-f96106ac869f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:38.786790 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c1319d81-086a-4155-b72b-f96106ac869f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:38.908413 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c1319d81-086a-4155-b72b-f96106ac869f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:38.916015 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c1319d81-086a-4155-b72b-f96106ac869f tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1502 microversion: 2.1 time: 0.141367 May 12 09:46:38.916586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 525/1048] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:38 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1502 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:39.472915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c8852900-3554-40ae-b613-6216b54f1988 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:39.473612 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c8852900-3554-40ae-b613-6216b54f1988 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:39.480264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8852900-3554-40ae-b613-6216b54f1988 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:39.480712 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8852900-3554-40ae-b613-6216b54f1988 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:39.481489 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8852900-3554-40ae-b613-6216b54f1988 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:39.482145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c8852900-3554-40ae-b613-6216b54f1988 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:39.612391 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c8852900-3554-40ae-b613-6216b54f1988 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:39.619721 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c8852900-3554-40ae-b613-6216b54f1988 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1682 microversion: 2.1 time: 0.151352 May 12 09:46:39.620285 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 524/1049] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:39 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:39.670955 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:39.672458 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:39.679382 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:39.679921 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:39.680800 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:39.681508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:39.814426 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:39.823320 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:39.824829 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:39.826147 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c6f15b09-2ddb-467d-aa79-7a8c5c0d412f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1810 microversion: 2.20 time: 0.159068 May 12 09:46:39.826704 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 526/1050] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:39 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:39.932298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2a993ce7-4614-402e-9e00-ccd411a1d710 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:39.932911 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2a993ce7-4614-402e-9e00-ccd411a1d710 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:39.938792 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2a993ce7-4614-402e-9e00-ccd411a1d710 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:39.939243 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2a993ce7-4614-402e-9e00-ccd411a1d710 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:39.940016 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2a993ce7-4614-402e-9e00-ccd411a1d710 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:39.941333 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2a993ce7-4614-402e-9e00-ccd411a1d710 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:40.078999 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2a993ce7-4614-402e-9e00-ccd411a1d710 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:40.086508 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2a993ce7-4614-402e-9e00-ccd411a1d710 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1502 microversion: 2.1 time: 0.157968 May 12 09:46:40.087087 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 525/1051] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:39 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:40.638553 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e4917efa-926b-4476-a4d7-89e351bc0c0d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:40.639077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e4917efa-926b-4476-a4d7-89e351bc0c0d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:40.645653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4917efa-926b-4476-a4d7-89e351bc0c0d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:40.646180 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4917efa-926b-4476-a4d7-89e351bc0c0d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:40.646947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4917efa-926b-4476-a4d7-89e351bc0c0d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:40.647385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e4917efa-926b-4476-a4d7-89e351bc0c0d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:40.844902 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:40.847444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:40.854355 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:40.855130 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:40.856308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:40.856960 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:40.868679 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e4917efa-926b-4476-a4d7-89e351bc0c0d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:40.879012 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e4917efa-926b-4476-a4d7-89e351bc0c0d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1682 microversion: 2.1 time: 0.245517 May 12 09:46:40.882654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 527/1052] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:40 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1682 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:40.992344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-b47851b6-01cb-487c-a4c7-36b94378690e req-14a673cd-cc98-4fcb-9895-b5d0f444d5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c5ecc5-d507-4ec5-8d70-c08225968aa0", "name": "network-vif-deleted", "tag": "0b0e76dc-66e5-4455-bb32-2661005e59fd"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:41.002157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-b47851b6-01cb-487c-a4c7-36b94378690e req-14a673cd-cc98-4fcb-9895-b5d0f444d5de service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:41.002441 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-b47851b6-01cb-487c-a4c7-36b94378690e req-14a673cd-cc98-4fcb-9895-b5d0f444d5de service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:41.015751 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-b47851b6-01cb-487c-a4c7-36b94378690e req-14a673cd-cc98-4fcb-9895-b5d0f444d5de service nova] Creating event network-vif-deleted:0b0e76dc-66e5-4455-bb32-2661005e59fd for instance 14c5ecc5-d507-4ec5-8d70-c08225968aa0 on hv-cinder-83769 May 12 09:46:41.023995 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-b47851b6-01cb-487c-a4c7-36b94378690e req-14a673cd-cc98-4fcb-9895-b5d0f444d5de service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 May 12 09:46:41.027142 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 528/1053] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:41.085760 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:41.094717 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:41.097217 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:41.100235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-590a8c1e-7791-4984-883f-51c9c1d94285 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1797 microversion: 2.20 time: 0.258618 May 12 09:46:41.102008 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 526/1054] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:46:40 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1797 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:46:41.110107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:41.110107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:41.115747 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:41.116603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:41.117586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:41.118226 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:41.152325 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:41.152681 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:41.153124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lazy-loading 'fault' on Instance uuid 14c5ecc5-d507-4ec5-8d70-c08225968aa0 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:46:41.212086 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:41.219484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-db4eedb6-7a7e-4fc8-b89a-4690cb9b7b30 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 200 len: 1303 microversion: 2.1 time: 0.119086 May 12 09:46:41.220275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 529/1055] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:41 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:41.738168 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-cd380f15-191b-4251-abef-f926aaabcdab req-bf7baea4-b964-421f-b3cb-af9c22c8b700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe60f94-7d27-4924-8df7-0a49d9455ade", "name": "network-vif-deleted", "tag": "5fd0072b-c35b-4eb8-95e5-e20e592d7b49"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:41.746193 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-cd380f15-191b-4251-abef-f926aaabcdab req-bf7baea4-b964-421f-b3cb-af9c22c8b700 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:41.746645 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-cd380f15-191b-4251-abef-f926aaabcdab req-bf7baea4-b964-421f-b3cb-af9c22c8b700 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:41.768869 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-cd380f15-191b-4251-abef-f926aaabcdab req-bf7baea4-b964-421f-b3cb-af9c22c8b700 service nova] Creating event network-vif-deleted:5fd0072b-c35b-4eb8-95e5-e20e592d7b49 for instance afe60f94-7d27-4924-8df7-0a49d9455ade on hv-cinder-83769 May 12 09:46:41.774040 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-cd380f15-191b-4251-abef-f926aaabcdab req-bf7baea4-b964-421f-b3cb-af9c22c8b700 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040374 May 12 09:46:41.774637 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 527/1056] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:41.899321 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:41.900663 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:41.908465 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:41.909539 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:41.910431 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:41.911099 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:41.949033 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:41.949499 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:41.949945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lazy-loading 'fault' on Instance uuid afe60f94-7d27-4924-8df7-0a49d9455ade {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:46:41.994575 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8297034cfa40438000e7d94419a429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b079fd0b329c4f1a856f71e0c8f98dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:42.001721 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-58baab52-facc-41a7-9ba8-2bd28d58ee1a tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 200 len: 1331 microversion: 2.1 time: 0.106411 May 12 09:46:42.002389 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 530/1057] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:41 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:42.238214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:42.239610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 14c5ecc5-d507-4ec5-8d70-c08225968aa0] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:42.255042 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:42.255042 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:42.255900 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:42.256345 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:42.271766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] HTTP exception thrown: Instance 14c5ecc5-d507-4ec5-8d70-c08225968aa0 could not be found. May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Request method failure captured: May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 HTTP/1.1 May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNdiNi8C6ndwdN1wMXB9Gr6CAJAVsBZfSwJo5EJlGpkBluHg0FcZ6m27PPsKRFlTvgCogDLrjPgpucIoPv7LwGsFE4dgyFLU1Y2d-i6eYlC1NzKlSMm1O4GJ6QGrfTzMBmvelpSXTPmsXpa9aZH333Ko5D1gP2Zh_jo62P2zq76-KTg May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: f905d25356874ac88be7ed35a624e230 May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-VolumesActionsTest-1151283881 May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:46:42.273438 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f905d25356874ac88be7ed35a624e230", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f905d25356874ac88be7ed35a624e230"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f905d25356874ac88be7ed35a624e230"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f905d25356874ac88be7ed35a624e230"}]}] May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-VolumesActionsTest-1151283881 May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: f905d25356874ac88be7ed35a624e230 May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-VolumesActionsTest-1151283881 May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-VolumesActionsTest-1151283881-project May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 8427a2000ab943f6a6fa72d068efe2ac May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-VolumesActionsTest-1151283881-project May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 14c5ecc5-d507-4ec5-8d70-c08225968aa0 could not be found. May 12 09:46:42.275241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '14c5ecc5-d507-4ec5-8d70-c08225968aa0'} May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14c5ecc5-d507-4ec5-8d70-c08225968aa0 could not be found. May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:42.276226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c5ecc5-d507-4ec5-8d70-c08225968aa0 could not be found. May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c5ecc5-d507-4ec5-8d70-c08225968aa0 could not be found. May 12 09:46:42.277813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:42.279274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Returning 404 to user: Instance 14c5ecc5-d507-4ec5-8d70-c08225968aa0 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:42.279274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-bc0bb68c-19bc-47ef-af39-6cbdecf03bf2 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0" status: 404 len: 111 microversion: 2.1 time: 0.042186 May 12 09:46:42.288219 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 528/1058] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:42 2022] GET /compute/v2.1/servers/14c5ecc5-d507-4ec5-8d70-c08225968aa0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:42.332316 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-396583375", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "networks": [{"uuid": "a979ad69-574d-4551-aeb4-f162ac77a9b9"}]}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:42.387421 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] validate_networks() for [('a979ad69-574d-4551-aeb4-f162ac77a9b9', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:46:42.733063 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:46:42.733488 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:46:42.733989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:46:42.734440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:46:42.735043 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:46:42.746661 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:42.747139 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:42.747937 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:42.748370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:42.766753 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Getting quotas for project f905d25356874ac88be7ed35a624e230. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:46:42.770755 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Getting quotas for user 8427a2000ab943f6a6fa72d068efe2ac and project f905d25356874ac88be7ed35a624e230. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:46:42.782003 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:46:42.784873 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:46:42.828309 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a0a0f7a2-28f0-4589-9f1b-13c16aa96cdd tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500072 May 12 09:46:42.828945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 531/1059] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:46:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:46:42.838880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3f3ef239-d930-4d85-bcda-04ebcdcaf124 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:42.839471 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3f3ef239-d930-4d85-bcda-04ebcdcaf124 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:42.895468 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-3f3ef239-d930-4d85-bcda-04ebcdcaf124 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:42.901853 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3f3ef239-d930-4d85-bcda-04ebcdcaf124 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1213 microversion: 2.1 time: 0.066903 May 12 09:46:42.902478 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 529/1060] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:42 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:46:43.019301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:43.019899 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:43.025776 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:43.026359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:43.027017 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:43.027458 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:43.041012 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade HTTP/1.1 May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:46:43.042712 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:43.044397 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'afe60f94-7d27-4924-8df7-0a49d9455ade'} May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:43.045299 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:43.046875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:43.048335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:43.048335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-0615895c-6cfc-40ac-9ce7-736439bf2117 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 404 len: 111 microversion: 2.1 time: 0.029915 May 12 09:46:43.048335 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 532/1061] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:43 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:43.054717 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9d8302e2-3fc4-42f9-aaef-82cbe09bf762 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '.version_select at 0x7f8725fdd0d0>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:43.073575 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9d8302e2-3fc4-42f9-aaef-82cbe09bf762 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673733912" status: 202 len: 0 microversion: 2.1 time: 0.022726 May 12 09:46:43.074405 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 530/1062] 10.222.0.60 () {58 vars in 1220 bytes} [Thu May 12 09:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1673733912 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:46:43.919398 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7589392e-d012-4039-8be0-e93e641be15d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:43.919916 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7589392e-d012-4039-8be0-e93e641be15d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:43.927025 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7589392e-d012-4039-8be0-e93e641be15d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:43.927484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7589392e-d012-4039-8be0-e93e641be15d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:43.928276 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7589392e-d012-4039-8be0-e93e641be15d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:43.928709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7589392e-d012-4039-8be0-e93e641be15d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:44.013533 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7589392e-d012-4039-8be0-e93e641be15d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:44.021436 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7589392e-d012-4039-8be0-e93e641be15d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1283 microversion: 2.1 time: 0.105999 May 12 09:46:44.022131 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 533/1063] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:43 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:44.836619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:44.837188 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:44.843711 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:44.844239 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:44.845096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:44.845531 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:44.860079 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: DELETE /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade HTTP/1.1 May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:46:44.861644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.863269 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'afe60f94-7d27-4924-8df7-0a49d9455ade'} May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:44.864076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.865379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:44.866669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:44.866669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7f22e80c-2175-4a46-ad29-27532849c27f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 404 len: 111 microversion: 2.1 time: 0.031186 May 12 09:46:44.866669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 531/1064] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:46:44 2022] DELETE /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:44.872043 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:44.872648 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: afe60f94-7d27-4924-8df7-0a49d9455ade] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:44.879160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:44.879610 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:44.880385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:44.880815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:44.897372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade HTTP/1.1 May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:46:44.898968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.900947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'afe60f94-7d27-4924-8df7-0a49d9455ade'} May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:44.902311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. May 12 09:46:44.904074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:44.905824 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance afe60f94-7d27-4924-8df7-0a49d9455ade could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:44.905824 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8a0c0fb4-ea26-4a86-8e4d-ceb8ca6ff50d tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade" status: 404 len: 111 microversion: 2.1 time: 0.032322 May 12 09:46:44.905824 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 534/1065] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:44 2022] GET /compute/v2.1/servers/afe60f94-7d27-4924-8df7-0a49d9455ade => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:45.038475 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-796f1c48-54a9-42a6-915a-431bbd95af90 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:45.039090 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-796f1c48-54a9-42a6-915a-431bbd95af90 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:45.045476 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-796f1c48-54a9-42a6-915a-431bbd95af90 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:45.045961 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-796f1c48-54a9-42a6-915a-431bbd95af90 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:45.047330 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-796f1c48-54a9-42a6-915a-431bbd95af90 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:45.047774 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-796f1c48-54a9-42a6-915a-431bbd95af90 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:45.278918 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-796f1c48-54a9-42a6-915a-431bbd95af90 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:45.287066 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-796f1c48-54a9-42a6-915a-431bbd95af90 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1313 microversion: 2.1 time: 0.252439 May 12 09:46:45.287673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 532/1066] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:45 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:45.373573 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-86ce05e8-b901-44e4-89a6-6bc8e0a4c549 req-e2aa77fd-d84d-4ff9-a756-ed702b3f919f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7af05b-3741-427d-a0cd-546697b3abb6", "tag": "aa30e7b2-4498-47a0-988c-5e68aa140b5b"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:45.383636 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-86ce05e8-b901-44e4-89a6-6bc8e0a4c549 req-e2aa77fd-d84d-4ff9-a756-ed702b3f919f service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:45.384107 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-86ce05e8-b901-44e4-89a6-6bc8e0a4c549 req-e2aa77fd-d84d-4ff9-a756-ed702b3f919f service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:45.397863 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-86ce05e8-b901-44e4-89a6-6bc8e0a4c549 req-e2aa77fd-d84d-4ff9-a756-ed702b3f919f service nova] Creating event network-changed:aa30e7b2-4498-47a0-988c-5e68aa140b5b for instance 2f7af05b-3741-427d-a0cd-546697b3abb6 on hv-cinder-83769 May 12 09:46:45.404190 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-86ce05e8-b901-44e4-89a6-6bc8e0a4c549 req-e2aa77fd-d84d-4ff9-a756-ed702b3f919f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034279 May 12 09:46:45.404795 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 535/1067] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:46.043654 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:46.044146 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:46.050150 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.050601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.051363 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.051798 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.064590 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: DELETE /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c HTTP/1.1 May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:46:46.066175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.067783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'c8d69574-dc82-4b58-a777-9618741b0e9c'} May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:46.068697 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.070212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.071637 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:46.071637 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-855e8ac8-af28-4e5e-81d4-953d96c5f4f0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 404 len: 111 microversion: 2.1 time: 0.027735 May 12 09:46:46.071637 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 533/1068] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:46:46 2022] DELETE /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:46.076593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:46.077293 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: c8d69574-dc82-4b58-a777-9618741b0e9c] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:46.083987 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.084437 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.085205 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.085644 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.099695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c HTTP/1.1 May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:46:46.101633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.102997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'c8d69574-dc82-4b58-a777-9618741b0e9c'} May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:46.103802 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. May 12 09:46:46.105152 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.106508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance c8d69574-dc82-4b58-a777-9618741b0e9c could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:46.106508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cd2518e6-09e2-41fc-b131-e756734c2d0f tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c" status: 404 len: 111 microversion: 2.1 time: 0.030349 May 12 09:46:46.106508 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 536/1069] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:46 2022] GET /compute/v2.1/servers/c8d69574-dc82-4b58-a777-9618741b0e9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:46.111271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:46.111793 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:46.117718 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.118210 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.118977 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.119412 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.132361 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: DELETE /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc HTTP/1.1 May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:46:46.133876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.135488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '33ce3bd7-6835-4430-8fd7-05afeb6925fc'} May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:46.136423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.138211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:46.139980 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:46.139980 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f4639be6-ab15-457e-8d58-d1ee309b4c53 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 404 len: 111 microversion: 2.1 time: 0.027828 May 12 09:46:46.139980 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 534/1070] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:46:46 2022] DELETE /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:46.144433 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:46.145037 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: 33ce3bd7-6835-4430-8fd7-05afeb6925fc] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:46.150960 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.151531 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.152292 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.152726 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.166419 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc HTTP/1.1 May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:46:46.167901 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.169491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '33ce3bd7-6835-4430-8fd7-05afeb6925fc'} May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:46.170470 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. May 12 09:46:46.171940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:46.173283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance 33ce3bd7-6835-4430-8fd7-05afeb6925fc could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:46.173283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-51bfc1dc-4674-4e83-8b5c-2c25e957732b tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc" status: 404 len: 111 microversion: 2.1 time: 0.029231 May 12 09:46:46.173283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 537/1071] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:46 2022] GET /compute/v2.1/servers/33ce3bd7-6835-4430-8fd7-05afeb6925fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:46.306899 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f46eb782-98a0-4006-837b-71d8b93ddc83 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:46.307451 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f46eb782-98a0-4006-837b-71d8b93ddc83 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:46.313214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f46eb782-98a0-4006-837b-71d8b93ddc83 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.313673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f46eb782-98a0-4006-837b-71d8b93ddc83 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.314589 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f46eb782-98a0-4006-837b-71d8b93ddc83 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:46.315053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f46eb782-98a0-4006-837b-71d8b93ddc83 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:46.447329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f46eb782-98a0-4006-837b-71d8b93ddc83 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:46.454502 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f46eb782-98a0-4006-837b-71d8b93ddc83 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1313 microversion: 2.1 time: 0.151509 May 12 09:46:46.455057 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 535/1072] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:46 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:47.303103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:47.303595 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:47.309848 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:47.310336 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:47.311119 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:47.311560 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:47.325308 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: DELETE /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 HTTP/1.1 May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:46:47.326867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.328452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'dc90e8c3-13f2-4b3e-91e8-396847cf6572'} May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:47.329301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.330859 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:46:47.333224 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:47.333224 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-29e54b6c-ee7b-4b63-9d4a-56054578eda0 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "DELETE /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 404 len: 111 microversion: 2.1 time: 0.029145 May 12 09:46:47.333224 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 538/1073] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:46:47 2022] DELETE /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:47.337280 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:47.337915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] [instance: dc90e8c3-13f2-4b3e-91e8-396847cf6572] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:47.344565 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:47.345018 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:47.345788 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:47.346264 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:47.359236 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] HTTP exception thrown: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Request method failure captured: May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 HTTP/1.1 May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNR9Q3KxJ4yx1qxrfM9JGCaLHb_wQYTLQrU-6RhmYgat3jHhgXobf2jvKCd-oE9HKXb4iktM3YNgsXCg01ho-HAppxox-GSiWxNJhvrt5umOtXyDnEyskamP63P2dVRWMIpBfyeElyZsk95c3v9tsTntKJedCvgtf6F_GpKvvBhAN6k May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:46:47.360761 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b079fd0b329c4f1a856f71e0c8f98dde", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b079fd0b329c4f1a856f71e0c8f98dde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b079fd0b329c4f1a856f71e0c8f98dde"}]}] May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: b079fd0b329c4f1a856f71e0c8f98dde May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1873308593 May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 6c8297034cfa40438000e7d94419a429 May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeNegativeTest-1873308593-project May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.362511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'dc90e8c3-13f2-4b3e-91e8-396847cf6572'} May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:47.363457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. May 12 09:46:47.364951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:47.366321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] Returning 404 to user: Instance dc90e8c3-13f2-4b3e-91e8-396847cf6572 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:47.366321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-88df75d0-dca7-4702-9549-59c139e02f31 tempest-AttachVolumeNegativeTest-1873308593 tempest-AttachVolumeNegativeTest-1873308593-project] 10.222.0.60 "GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572" status: 404 len: 111 microversion: 2.1 time: 0.028733 May 12 09:46:47.366321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 536/1074] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:47 2022] GET /compute/v2.1/servers/dc90e8c3-13f2-4b3e-91e8-396847cf6572 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:46:47.472140 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d2b72fb2-dacd-4757-9276-2fa0ded7fa35 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:47.472756 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d2b72fb2-dacd-4757-9276-2fa0ded7fa35 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:47.478694 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d2b72fb2-dacd-4757-9276-2fa0ded7fa35 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:47.479150 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d2b72fb2-dacd-4757-9276-2fa0ded7fa35 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:47.479951 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d2b72fb2-dacd-4757-9276-2fa0ded7fa35 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:47.480396 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d2b72fb2-dacd-4757-9276-2fa0ded7fa35 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:47.693497 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d2b72fb2-dacd-4757-9276-2fa0ded7fa35 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:47.700831 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d2b72fb2-dacd-4757-9276-2fa0ded7fa35 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1313 microversion: 2.1 time: 0.233133 May 12 09:46:47.701400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 539/1075] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:47 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:48.718244 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d07a4feb-238a-4aa2-bb1a-e980ef356896 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:48.718915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d07a4feb-238a-4aa2-bb1a-e980ef356896 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:48.725832 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d07a4feb-238a-4aa2-bb1a-e980ef356896 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:48.726330 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d07a4feb-238a-4aa2-bb1a-e980ef356896 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:48.728726 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d07a4feb-238a-4aa2-bb1a-e980ef356896 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:48.729181 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d07a4feb-238a-4aa2-bb1a-e980ef356896 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:48.992632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d07a4feb-238a-4aa2-bb1a-e980ef356896 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:49.000680 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d07a4feb-238a-4aa2-bb1a-e980ef356896 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1313 microversion: 2.1 time: 0.286512 May 12 09:46:49.001396 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 537/1076] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:48 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:50.019571 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-de8ec132-c753-4bf6-87b7-f57111c068cb tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:50.020459 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-de8ec132-c753-4bf6-87b7-f57111c068cb tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:50.027116 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-de8ec132-c753-4bf6-87b7-f57111c068cb tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:50.027701 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-de8ec132-c753-4bf6-87b7-f57111c068cb tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:50.028734 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-de8ec132-c753-4bf6-87b7-f57111c068cb tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:50.029440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-de8ec132-c753-4bf6-87b7-f57111c068cb tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:50.255571 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-de8ec132-c753-4bf6-87b7-f57111c068cb tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:50.263540 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-de8ec132-c753-4bf6-87b7-f57111c068cb tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1313 microversion: 2.1 time: 0.248520 May 12 09:46:50.264340 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 540/1077] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:50 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:51.277317 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-27697479-2c12-44bc-a4da-7d2b2f7443ad req-dadf669e-f762-4423-9b3d-48845a52aeb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7af05b-3741-427d-a0cd-546697b3abb6", "name": "network-vif-plugged", "status": "completed", "tag": "aa30e7b2-4498-47a0-988c-5e68aa140b5b"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:51.280601 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3ae3000d-daaa-483c-8d6b-69ff1fc30310 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:51.281211 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3ae3000d-daaa-483c-8d6b-69ff1fc30310 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:51.286501 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-27697479-2c12-44bc-a4da-7d2b2f7443ad req-dadf669e-f762-4423-9b3d-48845a52aeb2 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:51.287165 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-27697479-2c12-44bc-a4da-7d2b2f7443ad req-dadf669e-f762-4423-9b3d-48845a52aeb2 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:51.297384 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3ae3000d-daaa-483c-8d6b-69ff1fc30310 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:51.297844 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3ae3000d-daaa-483c-8d6b-69ff1fc30310 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:51.298366 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-27697479-2c12-44bc-a4da-7d2b2f7443ad req-dadf669e-f762-4423-9b3d-48845a52aeb2 service nova] Creating event network-vif-plugged:aa30e7b2-4498-47a0-988c-5e68aa140b5b for instance 2f7af05b-3741-427d-a0cd-546697b3abb6 on hv-cinder-83769 May 12 09:46:51.298647 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3ae3000d-daaa-483c-8d6b-69ff1fc30310 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:51.299260 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3ae3000d-daaa-483c-8d6b-69ff1fc30310 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:51.304140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-27697479-2c12-44bc-a4da-7d2b2f7443ad req-dadf669e-f762-4423-9b3d-48845a52aeb2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036405 May 12 09:46:51.304923 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 538/1078] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:51.478195 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3ae3000d-daaa-483c-8d6b-69ff1fc30310 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:51.485797 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3ae3000d-daaa-483c-8d6b-69ff1fc30310 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1313 microversion: 2.1 time: 0.208968 May 12 09:46:51.495106 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 541/1079] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:51 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:46:52.503916 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b9e02d0d-10c2-4b0e-ab88-edc586fd6b21 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:52.504782 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b9e02d0d-10c2-4b0e-ab88-edc586fd6b21 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:52.511705 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b9e02d0d-10c2-4b0e-ab88-edc586fd6b21 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:52.512407 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b9e02d0d-10c2-4b0e-ab88-edc586fd6b21 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:52.513166 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b9e02d0d-10c2-4b0e-ab88-edc586fd6b21 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:52.513599 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b9e02d0d-10c2-4b0e-ab88-edc586fd6b21 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:52.652532 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b9e02d0d-10c2-4b0e-ab88-edc586fd6b21 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:52.660400 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b9e02d0d-10c2-4b0e-ab88-edc586fd6b21 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1313 microversion: 2.1 time: 0.161117 May 12 09:46:52.661934 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 539/1080] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:52 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:53.676618 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c9c2575d-6330-4006-ae5b-28f93cec850d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:53.677238 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c9c2575d-6330-4006-ae5b-28f93cec850d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:53.683445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9c2575d-6330-4006-ae5b-28f93cec850d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:53.683888 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9c2575d-6330-4006-ae5b-28f93cec850d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:53.684723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9c2575d-6330-4006-ae5b-28f93cec850d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:53.685067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c9c2575d-6330-4006-ae5b-28f93cec850d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:53.700011 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4fe5d2b4-eef4-4a86-8483-d86839f8e5f8 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f872b259310>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:53.748426 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4fe5d2b4-eef4-4a86-8483-d86839f8e5f8 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/7f4991bb-6ba8-4122-a545-d7b958f63eae" status: 200 len: 350 microversion: 2.1 time: 0.052392 May 12 09:46:53.749589 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 540/1081] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:46:53 2022] GET /compute/v2.1/os-volumes/7f4991bb-6ba8-4122-a545-d7b958f63eae => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:46:53.818661 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c9c2575d-6330-4006-ae5b-28f93cec850d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:53.825925 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c9c2575d-6330-4006-ae5b-28f93cec850d tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1497 microversion: 2.1 time: 0.153301 May 12 09:46:53.826502 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 542/1082] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:53 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:54.999901 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0554fddd-1376-4f75-9bd7-7af43d205627 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:55.000408 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0554fddd-1376-4f75-9bd7-7af43d205627 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:55.007257 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0554fddd-1376-4f75-9bd7-7af43d205627 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:55.007703 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0554fddd-1376-4f75-9bd7-7af43d205627 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:55.008497 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0554fddd-1376-4f75-9bd7-7af43d205627 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:55.008927 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0554fddd-1376-4f75-9bd7-7af43d205627 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:55.035304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0554fddd-1376-4f75-9bd7-7af43d205627 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Going to try to terminate instance {{(pid=123509) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:46:55.061105 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f29a4495-1e03-45f6-af2c-cfeeab7118cb tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f8725aa7ca0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:55.111184 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f29a4495-1e03-45f6-af2c-cfeeab7118cb tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/497fe995-ead7-4ba4-96a9-8fe588548358" status: 200 len: 350 microversion: 2.1 time: 0.053861 May 12 09:46:55.111575 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0554fddd-1376-4f75-9bd7-7af43d205627 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "DELETE /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 204 len: 0 microversion: 2.1 time: 0.115517 May 12 09:46:55.112554 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 543/1083] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:46:55 2022] GET /compute/v2.1/os-volumes/497fe995-ead7-4ba4-96a9-8fe588548358 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:46:55.112864 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 541/1084] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:46:54 2022] DELETE /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:46:55.121346 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5635dcd2-d68c-49b6-8b76-a0f3f94d3446 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:55.122193 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5635dcd2-d68c-49b6-8b76-a0f3f94d3446 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:55.128711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5635dcd2-d68c-49b6-8b76-a0f3f94d3446 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:55.129157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5635dcd2-d68c-49b6-8b76-a0f3f94d3446 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:55.129953 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5635dcd2-d68c-49b6-8b76-a0f3f94d3446 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:55.130560 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5635dcd2-d68c-49b6-8b76-a0f3f94d3446 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:55.269724 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5635dcd2-d68c-49b6-8b76-a0f3f94d3446 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:55.277760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5635dcd2-d68c-49b6-8b76-a0f3f94d3446 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1503 microversion: 2.1 time: 0.160769 May 12 09:46:55.278617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 544/1085] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:55 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:46:56.299020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c59dffd8-a478-4ffb-a3ee-84f682764c9c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:56.300199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c59dffd8-a478-4ffb-a3ee-84f682764c9c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:56.306381 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c59dffd8-a478-4ffb-a3ee-84f682764c9c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:56.306821 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c59dffd8-a478-4ffb-a3ee-84f682764c9c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:56.307579 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c59dffd8-a478-4ffb-a3ee-84f682764c9c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:56.308007 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c59dffd8-a478-4ffb-a3ee-84f682764c9c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:56.441097 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c59dffd8-a478-4ffb-a3ee-84f682764c9c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:56.441298 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-97280fd4-0bb9-434c-a1cc-3b8d1adabb99 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f8725aa7c10>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:56.448511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c59dffd8-a478-4ffb-a3ee-84f682764c9c tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1503 microversion: 2.1 time: 0.153823 May 12 09:46:56.449080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 542/1086] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:56 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:56.488400 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-97280fd4-0bb9-434c-a1cc-3b8d1adabb99 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/d45e4807-85b3-43c4-a544-0859d05c1e1a" status: 200 len: 351 microversion: 2.1 time: 0.050884 May 12 09:46:56.488994 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 545/1087] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:46:56 2022] GET /compute/v2.1/os-volumes/d45e4807-85b3-43c4-a544-0859d05c1e1a => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:46:56.499986 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b9ae9dbc-fd04-49ba-889c-2356dfd5779d tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f87260bf9d0>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:56.579154 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b9ae9dbc-fd04-49ba-889c-2356dfd5779d tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082886 May 12 09:46:56.579722 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 543/1088] 10.222.0.60 () {58 vars in 1133 bytes} [Thu May 12 09:46:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:56.592194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ca4d128d-ac3b-4026-920d-48c2b563b170 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f8725aa0430>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:56.672981 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ca4d128d-ac3b-4026-920d-48c2b563b170 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084493 May 12 09:46:56.673555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 546/1089] 10.222.0.60 () {58 vars in 1148 bytes} [Thu May 12 09:46:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:56.685053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-82e22fbb-6fa5-48bb-8349-d872642ee7d3 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f872b258160>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:56.762681 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-82e22fbb-6fa5-48bb-8349-d872642ee7d3 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.081096 May 12 09:46:56.763247 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 544/1090] 10.222.0.60 () {58 vars in 1133 bytes} [Thu May 12 09:46:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:56.774942 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5feac1ab-da67-426a-a059-2157a2b50a52 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f87259b3d30>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:56.855471 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5feac1ab-da67-426a-a059-2157a2b50a52 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084396 May 12 09:46:56.856077 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 547/1091] 10.222.0.60 () {58 vars in 1166 bytes} [Thu May 12 09:46:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:56.867555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e25c53b9-a056-4530-972b-98055bc32e2e tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f872b259670>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:56.946468 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e25c53b9-a056-4530-972b-98055bc32e2e tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082599 May 12 09:46:56.947036 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 545/1092] 10.222.0.60 () {58 vars in 1169 bytes} [Thu May 12 09:46:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:56.959339 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e6024f21-a319-4512-ad2b-767a7c5bd308 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f87257dd3a0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:57.038980 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e6024f21-a319-4512-ad2b-767a7c5bd308 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084014 May 12 09:46:57.039589 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 548/1093] 10.222.0.60 () {58 vars in 1154 bytes} [Thu May 12 09:46:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:57.050732 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f67a88c8-f138-480c-84c2-50bd610adcf8 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f872b259d30>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:57.134544 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f67a88c8-f138-480c-84c2-50bd610adcf8 tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087591 May 12 09:46:57.135144 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 546/1094] 10.222.0.60 () {58 vars in 1187 bytes} [Thu May 12 09:46:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:57.151899 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-61882ac8-977a-4d3f-b663-e1efa6071b7f tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] Calling method '.version_select at 0x7f8725985550>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:57.232385 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-61882ac8-977a-4d3f-b663-e1efa6071b7f tempest-VolumesTestJSON-1049872169 tempest-VolumesTestJSON-1049872169-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084335 May 12 09:46:57.233059 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 549/1095] 10.222.0.60 () {58 vars in 1154 bytes} [Thu May 12 09:46:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:46:57.466484 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-970f1531-24b4-4632-bbb6-845eebff5891 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:57.467147 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-970f1531-24b4-4632-bbb6-845eebff5891 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:57.474140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-970f1531-24b4-4632-bbb6-845eebff5891 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:57.474596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-970f1531-24b4-4632-bbb6-845eebff5891 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:57.475460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-970f1531-24b4-4632-bbb6-845eebff5891 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:57.475907 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-970f1531-24b4-4632-bbb6-845eebff5891 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:57.848088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-970f1531-24b4-4632-bbb6-845eebff5891 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8427a2000ab943f6a6fa72d068efe2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f905d25356874ac88be7ed35a624e230', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:46:57.855794 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-970f1531-24b4-4632-bbb6-845eebff5891 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 200 len: 1503 microversion: 2.1 time: 0.393769 May 12 09:46:57.856369 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 547/1096] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:57 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:46:57.906267 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-8f1627fd-7e55-447d-8aad-234c7115ae32 req-5e1b9df4-698f-4213-9f62-144cbd080650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7af05b-3741-427d-a0cd-546697b3abb6", "name": "network-vif-deleted", "tag": "aa30e7b2-4498-47a0-988c-5e68aa140b5b"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:46:57.914917 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-8f1627fd-7e55-447d-8aad-234c7115ae32 req-5e1b9df4-698f-4213-9f62-144cbd080650 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:57.915372 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-8f1627fd-7e55-447d-8aad-234c7115ae32 req-5e1b9df4-698f-4213-9f62-144cbd080650 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:57.925730 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-8f1627fd-7e55-447d-8aad-234c7115ae32 req-5e1b9df4-698f-4213-9f62-144cbd080650 service nova] Creating event network-vif-deleted:aa30e7b2-4498-47a0-988c-5e68aa140b5b for instance 2f7af05b-3741-427d-a0cd-546697b3abb6 on hv-cinder-83769 May 12 09:46:57.930657 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-8f1627fd-7e55-447d-8aad-234c7115ae32 req-5e1b9df4-698f-4213-9f62-144cbd080650 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028539 May 12 09:46:57.931238 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 550/1097] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:46:58.872669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:46:58.873309 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] [instance: 2f7af05b-3741-427d-a0cd-546697b3abb6] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:46:58.879654 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:58.880100 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:58.880856 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:46:58.881287 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:46:58.894830 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] HTTP exception thrown: Instance 2f7af05b-3741-427d-a0cd-546697b3abb6 could not be found. May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Request method failure captured: May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 HTTP/1.1 May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNdiNi8C6ndwdN1wMXB9Gr6CAJAVsBZfSwJo5EJlGpkBluHg0FcZ6m27PPsKRFlTvgCogDLrjPgpucIoPv7LwGsFE4dgyFLU1Y2d-i6eYlC1NzKlSMm1O4GJ6QGrfTzMBmvelpSXTPmsXpa9aZH333Ko5D1gP2Zh_jo62P2zq76-KTg May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: f905d25356874ac88be7ed35a624e230 May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-VolumesActionsTest-1151283881 May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:46:58.896454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f905d25356874ac88be7ed35a624e230", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f905d25356874ac88be7ed35a624e230"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f905d25356874ac88be7ed35a624e230"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f905d25356874ac88be7ed35a624e230"}]}] May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-VolumesActionsTest-1151283881 May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: f905d25356874ac88be7ed35a624e230 May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-VolumesActionsTest-1151283881 May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-VolumesActionsTest-1151283881-project May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 8427a2000ab943f6a6fa72d068efe2ac May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-VolumesActionsTest-1151283881-project May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 2f7af05b-3741-427d-a0cd-546697b3abb6 could not be found. May 12 09:46:58.898375 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '2f7af05b-3741-427d-a0cd-546697b3abb6'} May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7af05b-3741-427d-a0cd-546697b3abb6 could not be found. May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:46:58.899365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7af05b-3741-427d-a0cd-546697b3abb6 could not be found. May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7af05b-3741-427d-a0cd-546697b3abb6 could not be found. May 12 09:46:58.900994 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:46:58.902448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] Returning 404 to user: Instance 2f7af05b-3741-427d-a0cd-546697b3abb6 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:46:58.902448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-123e8a8c-587d-43f8-af0a-22d2c583b475 tempest-VolumesActionsTest-1151283881 tempest-VolumesActionsTest-1151283881-project] 10.222.0.60 "GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6" status: 404 len: 111 microversion: 2.1 time: 0.029032 May 12 09:46:58.902448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 548/1098] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:46:58 2022] GET /compute/v2.1/servers/2f7af05b-3741-427d-a0cd-546697b3abb6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:48:01.194642 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-a9e89749-7a62-40d5-91bc-817931134aad tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:01.195414 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-a9e89749-7a62-40d5-91bc-817931134aad tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:01.202441 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a9e89749-7a62-40d5-91bc-817931134aad tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:01.202894 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a9e89749-7a62-40d5-91bc-817931134aad tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:01.203699 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a9e89749-7a62-40d5-91bc-817931134aad tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:01.204149 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-a9e89749-7a62-40d5-91bc-817931134aad tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:01.233117 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-a9e89749-7a62-40d5-91bc-817931134aad tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments/f0401807-29e8-4b34-9c1c-4948d34bb4ef" status: 200 len: 194 microversion: 2.20 time: 0.044427 May 12 09:48:01.233701 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 551/1099] 10.222.0.60 () {60 vars in 1453 bytes} [Thu May 12 09:48:01 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments/f0401807-29e8-4b34-9c1c-4948d34bb4ef => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:48:01.297639 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6d321b70-1d54-4007-964a-1a82937e52f1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:01.298244 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6d321b70-1d54-4007-964a-1a82937e52f1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:01.304516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6d321b70-1d54-4007-964a-1a82937e52f1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:01.304963 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6d321b70-1d54-4007-964a-1a82937e52f1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:01.305725 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6d321b70-1d54-4007-964a-1a82937e52f1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:01.306202 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6d321b70-1d54-4007-964a-1a82937e52f1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:01.386068 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.objects.instance [None req-6d321b70-1d54-4007-964a-1a82937e52f1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lazy-loading 'services' on Instance uuid 18552b7d-9ecc-4182-b0fd-726899815dcf {{(pid=123509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:48:01.456291 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6d321b70-1d54-4007-964a-1a82937e52f1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "DELETE /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments/f0401807-29e8-4b34-9c1c-4948d34bb4ef" status: 202 len: 0 microversion: 2.20 time: 0.163598 May 12 09:48:01.456883 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 549/1100] 10.222.0.60 () {60 vars in 1456 bytes} [Thu May 12 09:48:01 2022] DELETE /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments/f0401807-29e8-4b34-9c1c-4948d34bb4ef => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 09:48:01.466450 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b9225091-1150-41ac-8666-10e3157e5298 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:01.467560 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b9225091-1150-41ac-8666-10e3157e5298 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:01.474429 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b9225091-1150-41ac-8666-10e3157e5298 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:01.475004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b9225091-1150-41ac-8666-10e3157e5298 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:01.475885 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b9225091-1150-41ac-8666-10e3157e5298 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:01.476555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b9225091-1150-41ac-8666-10e3157e5298 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:01.507964 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b9225091-1150-41ac-8666-10e3157e5298 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046113 May 12 09:48:01.508528 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 552/1101] 10.222.0.60 () {60 vars in 1342 bytes} [Thu May 12 09:48:01 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:48:02.520910 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-801287a6-f09c-4926-a2b1-a23b5cd5adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:02.522166 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-801287a6-f09c-4926-a2b1-a23b5cd5adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:02.528717 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-801287a6-f09c-4926-a2b1-a23b5cd5adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:02.529170 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-801287a6-f09c-4926-a2b1-a23b5cd5adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:02.529948 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-801287a6-f09c-4926-a2b1-a23b5cd5adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:02.530382 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-801287a6-f09c-4926-a2b1-a23b5cd5adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:02.563054 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-801287a6-f09c-4926-a2b1-a23b5cd5adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046901 May 12 09:48:02.563760 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 550/1102] 10.222.0.60 () {60 vars in 1342 bytes} [Thu May 12 09:48:02 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:48:02.620862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-cdbf5ba8-bfd7-4e59-86f3-4143cd53415f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:02.621423 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cdbf5ba8-bfd7-4e59-86f3-4143cd53415f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:02.627699 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cdbf5ba8-bfd7-4e59-86f3-4143cd53415f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:02.628222 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cdbf5ba8-bfd7-4e59-86f3-4143cd53415f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:02.630023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cdbf5ba8-bfd7-4e59-86f3-4143cd53415f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:02.630023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-cdbf5ba8-bfd7-4e59-86f3-4143cd53415f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:02.655026 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-cdbf5ba8-bfd7-4e59-86f3-4143cd53415f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:48:02.732611 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-cdbf5ba8-bfd7-4e59-86f3-4143cd53415f tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "DELETE /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 204 len: 0 microversion: 2.20 time: 0.115351 May 12 09:48:02.733812 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 553/1103] 10.222.0.60 () {60 vars in 1279 bytes} [Thu May 12 09:48:02 2022] DELETE /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 09:48:02.742821 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:02.743423 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:02.749211 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:02.749655 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:02.750539 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:02.750971 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:02.883089 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:02.891397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:02.892930 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:02.894124 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2bc3cc84-a38d-4e67-b99b-654c6fff9bd9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.155940 May 12 09:48:02.895182 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 551/1104] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:02 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:48:03.914787 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:03.915488 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:03.921713 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:03.922172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:03.922979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:03.923440 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:04.054433 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:04.062168 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:04.063653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:04.064836 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-03696d28-a616-41dd-8d7b-63bd644ef2d8 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.154848 May 12 09:48:04.065573 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 554/1105] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:03 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:48:05.084507 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:05.085222 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:05.092052 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:05.092622 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:05.093610 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:05.094199 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:05.293616 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:05.302789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:05.304517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:05.306006 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-07ebe68a-6492-4e36-8ebb-6f51eb84ff84 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 200 len: 1725 microversion: 2.20 time: 0.225712 May 12 09:48:05.317052 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 552/1106] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:05 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:48:05.697355 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-96ac2196-fbee-4301-a8aa-417a780b8f0a req-8d3c91f0-e396-4706-be99-36fcb4d80273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18552b7d-9ecc-4182-b0fd-726899815dcf", "name": "network-vif-deleted", "tag": "b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:48:05.706650 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-96ac2196-fbee-4301-a8aa-417a780b8f0a req-8d3c91f0-e396-4706-be99-36fcb4d80273 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:05.707126 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-96ac2196-fbee-4301-a8aa-417a780b8f0a req-8d3c91f0-e396-4706-be99-36fcb4d80273 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:05.726028 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-96ac2196-fbee-4301-a8aa-417a780b8f0a req-8d3c91f0-e396-4706-be99-36fcb4d80273 service nova] Creating event network-vif-deleted:b33ba246-ac04-4bf2-a1cb-5eb7bcb17a5b for instance 18552b7d-9ecc-4182-b0fd-726899815dcf on hv-cinder-83769 May 12 09:48:05.737054 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-96ac2196-fbee-4301-a8aa-417a780b8f0a req-8d3c91f0-e396-4706-be99-36fcb4d80273 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043166 May 12 09:48:05.737752 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 555/1107] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:48:06.324723 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:06.325957 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:06.332830 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:06.333286 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:06.334087 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:06.334524 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:06.348875 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] HTTP exception thrown: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Request method failure captured: May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf HTTP/1.1 May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNa2j2n104jiX9cXXMJgV4ejMNWv-yqx_Rv3irjrG2BAJoHwbnTNAEiT14QzzEJR6x1O9NcwKrmcGdkA-1TAu13QJmGV6PikZrzLUNQovL4CXWtdLeKxlsuBnPWx_h0TfAFFsCOi_XuzyQuRtxToj8Q4Ahre2-8im3yo7HKhDJIf6DY May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Openstack-Nova-Api-Version: 2.20 May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: b879e240eb4f48139e28cc43223b21da May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:48:06.350805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b879e240eb4f48139e28cc43223b21da", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}] May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: b879e240eb4f48139e28cc43223b21da May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: f739359acd844279aa56ef7d69f4c299 May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:48:06.352699 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '18552b7d-9ecc-4182-b0fd-726899815dcf'} May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:48:06.353867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:48:06.355555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:48:06.356933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Returning 404 to user: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:48:06.356933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-03ee4423-8f81-42bc-844b-82a845856fdd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 404 len: 111 microversion: 2.20 time: 0.031452 May 12 09:48:06.356933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 553/1108] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:06 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 09:48:06.363357 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-991209f8-bb6b-45c7-8ed7-3415000da878 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '.version_select at 0x7f872597b040>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:06.386587 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-991209f8-bb6b-45c7-8ed7-3415000da878 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924939188" status: 204 len: 0 microversion: 2.20 time: 0.027537 May 12 09:48:06.389939 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 556/1109] 10.222.0.60 () {60 vars in 1261 bytes} [Thu May 12 09:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924939188 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 09:48:07.079828 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-601104e2-fbb9-41e9-8eab-12ac312fa37d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'create', calling method: .version_select at 0x7f87260bfc10>, body: {"keypair": {"name": "tempest-keypair-1896670202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWOaeuVwCGHhaUmr81Olw3Fk3u/3IXiVhMmVrSPaiwJh5k0ghj55mbQIojpJ4zv45bBiRgPmqNXctfnRCB9dwm8PjIFxU/sPiI/STynYowg9EuU62BrhosfSaii92LhVA=="}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:48:07.095808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-601104e2-fbb9-41e9-8eab-12ac312fa37d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Getting quotas for project b879e240eb4f48139e28cc43223b21da. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:48:07.105185 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-601104e2-fbb9-41e9-8eab-12ac312fa37d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Getting quotas for user f739359acd844279aa56ef7d69f4c299 and project b879e240eb4f48139e28cc43223b21da. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:48:07.129757 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-601104e2-fbb9-41e9-8eab-12ac312fa37d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053859 May 12 09:48:07.130416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 554/1110] 10.222.0.60 () {62 vars in 1199 bytes} [Thu May 12 09:48:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 12 09:48:08.420641 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1307389008", "imageRef": "91f4cb8d-dc16-4d9f-abcc-f60eb9d02107", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e493ca3-e280-43b9-b225-da7bca606395"}], "security_groups": [{"name": "tempest-securitygroup--1196928473"}], "key_name": "tempest-keypair-1896670202", "user_data": "}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:48:08.522076 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] validate_networks() for [('9e493ca3-e280-43b9-b225-da7bca606395', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:48:08.878780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:48:08.879780 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:48:08.880248 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:48:08.880651 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:48:08.881057 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:48:08.889812 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:08.890296 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:08.891079 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:08.891509 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:08.912378 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Getting quotas for project b879e240eb4f48139e28cc43223b21da. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:48:08.916442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Getting quotas for user f739359acd844279aa56ef7d69f4c299 and project b879e240eb4f48139e28cc43223b21da. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:48:08.928214 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:48:08.930747 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91f4cb8d-dc16-4d9f-abcc-f60eb9d02107',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:48:08.981747 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-13a2f5e0-b1ae-4c3c-afbc-3d1cbc46b2ba tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.565948 May 12 09:48:08.982609 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 557/1111] 10.222.0.60 () {62 vars in 1187 bytes} [Thu May 12 09:48:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 09:48:08.993990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c8d7bf56-f2e2-452a-9e89-9d74443da4ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:08.994604 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c8d7bf56-f2e2-452a-9e89-9d74443da4ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:09.056063 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c8d7bf56-f2e2-452a-9e89-9d74443da4ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:09.063555 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c8d7bf56-f2e2-452a-9e89-9d74443da4ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:09.065061 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c8d7bf56-f2e2-452a-9e89-9d74443da4ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:09.066184 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c8d7bf56-f2e2-452a-9e89-9d74443da4ec tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1282 microversion: 2.20 time: 0.076764 May 12 09:48:09.069430 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 555/1112] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:08 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:48:10.087573 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:10.088263 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:10.095283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:10.095804 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:10.096744 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:10.097342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:10.157726 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:10.165841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:10.167348 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:10.168424 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-56a1a34a-8fe1-42b7-850d-151ba00677cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1340 microversion: 2.20 time: 0.085326 May 12 09:48:10.168974 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 558/1113] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:10 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1340 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:48:11.187728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:11.188345 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:11.199619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:11.200073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:11.200855 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:11.203072 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:11.409957 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:11.423201 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:11.424806 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:11.426074 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7891da85-0293-4db5-a61d-68207af1af60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1408 microversion: 2.20 time: 0.242477 May 12 09:48:11.426686 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 556/1114] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:11 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:48:11.522047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-b32019b6-d234-45bb-a766-bb2e1ff9755f req-4e3fa625-e2ec-499f-98fb-5a8e695603ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a27c8e-623a-4df5-9552-03cef9e9d0d7", "tag": "44a51ff9-5482-46c9-a3f0-25e1a93e8a55"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:48:11.533289 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-b32019b6-d234-45bb-a766-bb2e1ff9755f req-4e3fa625-e2ec-499f-98fb-5a8e695603ac service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:11.534287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-b32019b6-d234-45bb-a766-bb2e1ff9755f req-4e3fa625-e2ec-499f-98fb-5a8e695603ac service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:11.557222 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-b32019b6-d234-45bb-a766-bb2e1ff9755f req-4e3fa625-e2ec-499f-98fb-5a8e695603ac service nova] Creating event network-changed:44a51ff9-5482-46c9-a3f0-25e1a93e8a55 for instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 on hv-cinder-83769 May 12 09:48:11.571775 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-b32019b6-d234-45bb-a766-bb2e1ff9755f req-4e3fa625-e2ec-499f-98fb-5a8e695603ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054534 May 12 09:48:11.586097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 559/1115] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:48:12.443884 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:12.444487 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:12.450632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:12.451078 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:12.451835 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:12.452268 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:12.581265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:12.589713 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:12.591251 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:12.592353 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4f7f62a1-30a3-4ab5-9466-402a1f68d65c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1408 microversion: 2.20 time: 0.152348 May 12 09:48:12.592862 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 557/1116] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:12 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:48:13.611708 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:13.612619 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:13.619324 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:13.619760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:13.620528 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:13.620965 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:13.755297 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:13.766749 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:13.768260 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:13.770055 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-33084b07-d134-4e83-a0b0-bc90821589cf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1408 microversion: 2.20 time: 0.162419 May 12 09:48:13.770624 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 560/1117] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:13 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:48:14.788467 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:14.789070 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:14.795454 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:14.795904 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:14.796659 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:14.797095 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:14.927992 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:14.935602 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:14.937096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:14.938215 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-527906cd-59f7-4821-8b6e-268438a30200 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1408 microversion: 2.20 time: 0.154277 May 12 09:48:14.938772 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 558/1118] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:14 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:48:15.955671 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:15.956271 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:15.963491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:15.963935 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:15.964695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:15.965127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:16.091324 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:16.099927 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:16.101563 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:16.102707 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-08e01787-fd0d-4f71-86f9-a9bca56cc902 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1408 microversion: 2.20 time: 0.151026 May 12 09:48:16.103301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 561/1119] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:15 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:48:17.121010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:17.121618 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:17.127465 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:17.127914 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:17.128669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:17.129105 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:17.258759 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:17.266927 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:17.268240 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:17.269850 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f6daf6e7-45de-431c-adbc-9993fedcef65 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1408 microversion: 2.20 time: 0.152610 May 12 09:48:17.270440 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 559/1120] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:17 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 09:48:17.427259 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-c3e24dbf-03e6-4ed0-9839-39b5306455f1 req-550eb97d-91c5-4afe-bbed-acd7296d8f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a27c8e-623a-4df5-9552-03cef9e9d0d7", "name": "network-vif-plugged", "status": "completed", "tag": "44a51ff9-5482-46c9-a3f0-25e1a93e8a55"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:48:17.436244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-c3e24dbf-03e6-4ed0-9839-39b5306455f1 req-550eb97d-91c5-4afe-bbed-acd7296d8f24 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:17.436693 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-c3e24dbf-03e6-4ed0-9839-39b5306455f1 req-550eb97d-91c5-4afe-bbed-acd7296d8f24 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:17.447579 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-c3e24dbf-03e6-4ed0-9839-39b5306455f1 req-550eb97d-91c5-4afe-bbed-acd7296d8f24 service nova] Creating event network-vif-plugged:44a51ff9-5482-46c9-a3f0-25e1a93e8a55 for instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 on hv-cinder-83769 May 12 09:48:17.452387 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-c3e24dbf-03e6-4ed0-9839-39b5306455f1 req-550eb97d-91c5-4afe-bbed-acd7296d8f24 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028852 May 12 09:48:17.452971 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 562/1121] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:48:18.287463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:18.288063 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:18.294337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:18.294783 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:18.295539 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:18.295969 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:18.421250 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:18.428937 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:18.430446 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:18.431541 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4f347938-9205-4e6a-818e-75ec9ffd1234 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1408 microversion: 2.20 time: 0.147978 May 12 09:48:18.432091 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 560/1122] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:18 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:48:19.616689 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:19.617393 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:19.623596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:19.624048 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:19.624818 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:19.625256 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:19.752862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:19.760607 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:19.762127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:19.763263 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-728ce527-97e3-4b4c-a2a2-2d84d614e4bf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1600 microversion: 2.20 time: 0.316307 May 12 09:48:19.764084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 563/1123] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:48:19 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1600 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:48:19.781002 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-dea588b5-d469-4458-ac95-3b921e8f06dd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:19.781535 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-dea588b5-d469-4458-ac95-3b921e8f06dd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:19.788353 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dea588b5-d469-4458-ac95-3b921e8f06dd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:19.788809 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dea588b5-d469-4458-ac95-3b921e8f06dd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:19.789584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dea588b5-d469-4458-ac95-3b921e8f06dd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:19.790058 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-dea588b5-d469-4458-ac95-3b921e8f06dd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:19.864359 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-dea588b5-d469-4458-ac95-3b921e8f06dd tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087146 May 12 09:48:19.864949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 561/1124] 10.222.0.60 () {60 vars in 1315 bytes} [Thu May 12 09:48:19 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:48:21.091304 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-52ac7513-53af-42d5-b1b6-b18377dc899f req-b93d9ec7-3d44-4a79-8481-77ec7f514f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a27c8e-623a-4df5-9552-03cef9e9d0d7", "tag": "44a51ff9-5482-46c9-a3f0-25e1a93e8a55"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:48:21.101178 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-52ac7513-53af-42d5-b1b6-b18377dc899f req-b93d9ec7-3d44-4a79-8481-77ec7f514f59 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:21.101821 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-52ac7513-53af-42d5-b1b6-b18377dc899f req-b93d9ec7-3d44-4a79-8481-77ec7f514f59 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:21.115913 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-52ac7513-53af-42d5-b1b6-b18377dc899f req-b93d9ec7-3d44-4a79-8481-77ec7f514f59 service nova] Creating event network-changed:44a51ff9-5482-46c9-a3f0-25e1a93e8a55 for instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 on hv-cinder-83769 May 12 09:48:21.120754 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-52ac7513-53af-42d5-b1b6-b18377dc899f req-b93d9ec7-3d44-4a79-8481-77ec7f514f59 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033209 May 12 09:48:21.121374 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 564/1125] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:48:33.810728 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-102a873d-0f5f-4be3-b1b0-a8297545a350 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Action: 'create', calling method: .version_select at 0x7f8726111d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-744304972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOy9L45dPc+H2MyHsJIitRV2J/Z9+f8Qc9CGESh0hsfBb9shc/BI61HY9E3Eha1PDmkdi4jj0RtJDMgNf+D1TT1t+JAb4Lt9jBfmMSTQgDvsQ4OdzLEkvMa0mmB57HWmA=="}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:48:33.824245 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-102a873d-0f5f-4be3-b1b0-a8297545a350 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Getting quotas for project 6e6bc2241970493783de557e3f690105. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:48:33.827881 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-102a873d-0f5f-4be3-b1b0-a8297545a350 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Getting quotas for user 06be00f6a9ad465195c7606883b4160d and project 6e6bc2241970493783de557e3f690105. Resources: {'key_pairs'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:48:33.849567 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-102a873d-0f5f-4be3-b1b0-a8297545a350 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.216182 May 12 09:48:33.853519 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 562/1126] 10.222.0.60 () {60 vars in 1158 bytes} [Thu May 12 09:48:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:48:51.934510 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:48:51.935193 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Thu May 12 09:48:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:48:56.196796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1532717748", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-744304972", "security_groups": [{"name": "tempest-secgroup-smoke-176244007"}], "block_device_mapping_v2": [{"uuid": "7296c798-58f7-4a30-893e-f78197c2aa10", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6f9b602-5994-4479-ba8e-6005a9bbaa39"}]}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:48:56.307491 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.network.neutron [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] validate_networks() for [('f6f9b602-5994-4479-ba8e-6005a9bbaa39', None, None, None, None, None)] {{(pid=123510) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:48:56.665277 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Flavor limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:48:56.665695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Image limits 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:48:56.666196 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Flavor pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:48:56.666603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Image pref 0:0:0 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:48:56.667005 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.virt.hardware [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123510) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:48:56.676021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:56.676467 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:56.677284 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:56.677715 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:56.693460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Getting quotas for project 6e6bc2241970493783de557e3f690105. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:48:56.697268 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.quota [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Getting quotas for user 06be00f6a9ad465195c7606883b4160d and project 6e6bc2241970493783de557e3f690105. Resources: {'cores', 'instances', 'ram'} {{(pid=123510) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:48:56.751737 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Going to run 1 instances... {{(pid=123510) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:48:56.753868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7296c798-58f7-4a30-893e-f78197c2aa10',volume_size=None,volume_type=None)] {{(pid=123510) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:48:56.876483 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e59f4ed5-b183-4c13-b174-5bf3aff4ae64 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.684322 May 12 09:48:56.877310 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 565/1127] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:48:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:48:56.887214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6f9c6dac-22a7-4561-80c6-6ef0d068ae0c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:56.887827 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6f9c6dac-22a7-4561-80c6-6ef0d068ae0c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:56.941282 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6f9c6dac-22a7-4561-80c6-6ef0d068ae0c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:56.947832 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6f9c6dac-22a7-4561-80c6-6ef0d068ae0c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1094 microversion: 2.1 time: 0.064644 May 12 09:48:56.948400 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 563/1128] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:48:56 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:48:57.965096 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-99d961b0-fa9d-4800-b96d-0e7042518031 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:57.965974 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-99d961b0-fa9d-4800-b96d-0e7042518031 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:57.973748 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-99d961b0-fa9d-4800-b96d-0e7042518031 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:57.974293 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-99d961b0-fa9d-4800-b96d-0e7042518031 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:57.975145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-99d961b0-fa9d-4800-b96d-0e7042518031 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:57.975624 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-99d961b0-fa9d-4800-b96d-0e7042518031 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:58.035029 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-99d961b0-fa9d-4800-b96d-0e7042518031 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:58.042225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-99d961b0-fa9d-4800-b96d-0e7042518031 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1210 microversion: 2.1 time: 0.081027 May 12 09:48:58.042788 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 566/1129] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:48:57 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:48:59.059964 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0efb9fd2-271b-4465-81dd-9aa9ef37b592 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:48:59.060579 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0efb9fd2-271b-4465-81dd-9aa9ef37b592 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:48:59.067927 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0efb9fd2-271b-4465-81dd-9aa9ef37b592 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:59.068757 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0efb9fd2-271b-4465-81dd-9aa9ef37b592 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:59.069737 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0efb9fd2-271b-4465-81dd-9aa9ef37b592 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:59.070200 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0efb9fd2-271b-4465-81dd-9aa9ef37b592 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:59.256957 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0efb9fd2-271b-4465-81dd-9aa9ef37b592 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:48:59.264648 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0efb9fd2-271b-4465-81dd-9aa9ef37b592 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1277 microversion: 2.1 time: 0.208381 May 12 09:48:59.265221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 564/1130] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:48:59 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:48:59.513025 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-4f0224a1-907a-4917-bddc-ece6905ac38c req-f93d5c11-2965-4a1c-a7e7-0892203fb037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c701302e-c5c6-409c-9ec9-034448c9b961", "tag": "ba0739a1-e943-4513-865f-943e7ca3eba8"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:48:59.524064 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-4f0224a1-907a-4917-bddc-ece6905ac38c req-f93d5c11-2965-4a1c-a7e7-0892203fb037 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:48:59.524850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-4f0224a1-907a-4917-bddc-ece6905ac38c req-f93d5c11-2965-4a1c-a7e7-0892203fb037 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:48:59.552145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-4f0224a1-907a-4917-bddc-ece6905ac38c req-f93d5c11-2965-4a1c-a7e7-0892203fb037 service nova] Creating event network-changed:ba0739a1-e943-4513-865f-943e7ca3eba8 for instance c701302e-c5c6-409c-9ec9-034448c9b961 on hv-cinder-83769 May 12 09:48:59.563047 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-4f0224a1-907a-4917-bddc-ece6905ac38c req-f93d5c11-2965-4a1c-a7e7-0892203fb037 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053629 May 12 09:48:59.563884 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 567/1131] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:49:00.281566 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ac5e320d-66a5-401e-a763-cfba8d284d7e tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:00.282228 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ac5e320d-66a5-401e-a763-cfba8d284d7e tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:00.288534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac5e320d-66a5-401e-a763-cfba8d284d7e tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:00.288985 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac5e320d-66a5-401e-a763-cfba8d284d7e tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:00.289752 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac5e320d-66a5-401e-a763-cfba8d284d7e tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:00.290220 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac5e320d-66a5-401e-a763-cfba8d284d7e tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:00.415504 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ac5e320d-66a5-401e-a763-cfba8d284d7e tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:00.422738 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ac5e320d-66a5-401e-a763-cfba8d284d7e tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.145157 May 12 09:49:00.423304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 565/1132] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:00 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:01.440745 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-491cfb2c-07d7-415f-8db0-bed2f363a5c9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:01.441359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-491cfb2c-07d7-415f-8db0-bed2f363a5c9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:01.447392 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-491cfb2c-07d7-415f-8db0-bed2f363a5c9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:01.447838 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-491cfb2c-07d7-415f-8db0-bed2f363a5c9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:01.448593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-491cfb2c-07d7-415f-8db0-bed2f363a5c9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:01.449025 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-491cfb2c-07d7-415f-8db0-bed2f363a5c9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:01.701548 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-491cfb2c-07d7-415f-8db0-bed2f363a5c9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:01.709213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-491cfb2c-07d7-415f-8db0-bed2f363a5c9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.273206 May 12 09:49:01.709770 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 568/1133] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:01 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:02.726225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-034cd499-d73e-44a6-801f-670833ed6e8f tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:02.726865 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-034cd499-d73e-44a6-801f-670833ed6e8f tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:02.733179 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-034cd499-d73e-44a6-801f-670833ed6e8f tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:02.733639 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-034cd499-d73e-44a6-801f-670833ed6e8f tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:02.734437 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-034cd499-d73e-44a6-801f-670833ed6e8f tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:02.734882 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-034cd499-d73e-44a6-801f-670833ed6e8f tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:02.861031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-034cd499-d73e-44a6-801f-670833ed6e8f tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:02.868289 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-034cd499-d73e-44a6-801f-670833ed6e8f tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.146453 May 12 09:49:02.868843 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 566/1134] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:02 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:03.885291 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f391d93b-4989-4ae8-97c6-4d5816098a46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:03.885978 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f391d93b-4989-4ae8-97c6-4d5816098a46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:03.892875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f391d93b-4989-4ae8-97c6-4d5816098a46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:03.893323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f391d93b-4989-4ae8-97c6-4d5816098a46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:03.894166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f391d93b-4989-4ae8-97c6-4d5816098a46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:03.894603 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f391d93b-4989-4ae8-97c6-4d5816098a46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:04.020123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f391d93b-4989-4ae8-97c6-4d5816098a46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:04.027295 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f391d93b-4989-4ae8-97c6-4d5816098a46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.145879 May 12 09:49:04.027861 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 569/1135] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:03 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:05.044124 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ffe7df5d-bb6d-4bba-8b98-9c166f684afb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:05.044725 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ffe7df5d-bb6d-4bba-8b98-9c166f684afb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:05.051322 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ffe7df5d-bb6d-4bba-8b98-9c166f684afb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:05.051762 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ffe7df5d-bb6d-4bba-8b98-9c166f684afb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:05.052517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ffe7df5d-bb6d-4bba-8b98-9c166f684afb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:05.052951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ffe7df5d-bb6d-4bba-8b98-9c166f684afb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:05.449466 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ffe7df5d-bb6d-4bba-8b98-9c166f684afb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:05.456636 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ffe7df5d-bb6d-4bba-8b98-9c166f684afb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.416434 May 12 09:49:05.457204 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 567/1136] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:05 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:06.473120 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4fff7e9c-dd1c-4d2b-b7d3-457deae7a49d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:06.473734 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4fff7e9c-dd1c-4d2b-b7d3-457deae7a49d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:06.480097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4fff7e9c-dd1c-4d2b-b7d3-457deae7a49d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:06.480547 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4fff7e9c-dd1c-4d2b-b7d3-457deae7a49d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:06.481312 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4fff7e9c-dd1c-4d2b-b7d3-457deae7a49d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:06.481749 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4fff7e9c-dd1c-4d2b-b7d3-457deae7a49d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:06.605928 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4fff7e9c-dd1c-4d2b-b7d3-457deae7a49d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:06.613666 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4fff7e9c-dd1c-4d2b-b7d3-457deae7a49d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.144386 May 12 09:49:06.614286 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 570/1137] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:06 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:07.630688 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3f9a9382-5d90-4f41-8b75-016dcc425f36 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:07.631520 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-3f9a9382-5d90-4f41-8b75-016dcc425f36 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:07.637859 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3f9a9382-5d90-4f41-8b75-016dcc425f36 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:07.638337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3f9a9382-5d90-4f41-8b75-016dcc425f36 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:07.639096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3f9a9382-5d90-4f41-8b75-016dcc425f36 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:07.639794 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-3f9a9382-5d90-4f41-8b75-016dcc425f36 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:07.773115 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-3f9a9382-5d90-4f41-8b75-016dcc425f36 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:07.780843 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3f9a9382-5d90-4f41-8b75-016dcc425f36 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.153832 May 12 09:49:07.781113 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 568/1138] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:07 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:08.796548 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1ad4aeb5-00ca-41ee-b39f-fb4228be7791 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:08.797181 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1ad4aeb5-00ca-41ee-b39f-fb4228be7791 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:08.804155 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ad4aeb5-00ca-41ee-b39f-fb4228be7791 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:08.804598 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ad4aeb5-00ca-41ee-b39f-fb4228be7791 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:08.805355 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ad4aeb5-00ca-41ee-b39f-fb4228be7791 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:08.805815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1ad4aeb5-00ca-41ee-b39f-fb4228be7791 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:08.933983 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1ad4aeb5-00ca-41ee-b39f-fb4228be7791 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:08.941790 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1ad4aeb5-00ca-41ee-b39f-fb4228be7791 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.149128 May 12 09:49:08.942380 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 571/1139] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:08 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:09.736217 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-1616b5c6-1e49-454e-bf0c-1c49a32667bd req-f80ce3c7-b172-4b12-9ea9-8fec5cab6302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c701302e-c5c6-409c-9ec9-034448c9b961", "name": "network-vif-plugged", "status": "completed", "tag": "ba0739a1-e943-4513-865f-943e7ca3eba8"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:49:09.745146 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-1616b5c6-1e49-454e-bf0c-1c49a32667bd req-f80ce3c7-b172-4b12-9ea9-8fec5cab6302 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:09.745624 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-1616b5c6-1e49-454e-bf0c-1c49a32667bd req-f80ce3c7-b172-4b12-9ea9-8fec5cab6302 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:09.758181 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-1616b5c6-1e49-454e-bf0c-1c49a32667bd req-f80ce3c7-b172-4b12-9ea9-8fec5cab6302 service nova] Creating event network-vif-plugged:ba0739a1-e943-4513-865f-943e7ca3eba8 for instance c701302e-c5c6-409c-9ec9-034448c9b961 on hv-cinder-83769 May 12 09:49:09.763638 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-1616b5c6-1e49-454e-bf0c-1c49a32667bd req-f80ce3c7-b172-4b12-9ea9-8fec5cab6302 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031102 May 12 09:49:09.764744 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 569/1140] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:49:09.959981 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-82bce879-f8df-466a-a28f-fe4e8e328573 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:09.960543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-82bce879-f8df-466a-a28f-fe4e8e328573 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:09.966559 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-82bce879-f8df-466a-a28f-fe4e8e328573 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:09.967008 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-82bce879-f8df-466a-a28f-fe4e8e328573 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:09.967783 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-82bce879-f8df-466a-a28f-fe4e8e328573 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:09.968220 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-82bce879-f8df-466a-a28f-fe4e8e328573 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:10.129960 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-82bce879-f8df-466a-a28f-fe4e8e328573 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:10.137221 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-82bce879-f8df-466a-a28f-fe4e8e328573 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.181177 May 12 09:49:10.137779 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 572/1141] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:09 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:11.154399 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-1f6cc339-c0fa-40fb-8a3f-fa346ced8b1b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:11.155088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-1f6cc339-c0fa-40fb-8a3f-fa346ced8b1b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:11.161558 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1f6cc339-c0fa-40fb-8a3f-fa346ced8b1b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:11.162047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1f6cc339-c0fa-40fb-8a3f-fa346ced8b1b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:11.162800 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1f6cc339-c0fa-40fb-8a3f-fa346ced8b1b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:11.163225 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-1f6cc339-c0fa-40fb-8a3f-fa346ced8b1b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:11.338240 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-1f6cc339-c0fa-40fb-8a3f-fa346ced8b1b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:11.345630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-1f6cc339-c0fa-40fb-8a3f-fa346ced8b1b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1265 microversion: 2.1 time: 0.195458 May 12 09:49:11.346228 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 570/1142] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:11 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:12.362706 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8e24f166-cf17-4d64-96ad-7b94a60ddab7 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:12.363241 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8e24f166-cf17-4d64-96ad-7b94a60ddab7 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:12.369571 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e24f166-cf17-4d64-96ad-7b94a60ddab7 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:12.370051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e24f166-cf17-4d64-96ad-7b94a60ddab7 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:12.370815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e24f166-cf17-4d64-96ad-7b94a60ddab7 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:12.371252 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8e24f166-cf17-4d64-96ad-7b94a60ddab7 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:12.501564 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-8e24f166-cf17-4d64-96ad-7b94a60ddab7 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:12.508843 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8e24f166-cf17-4d64-96ad-7b94a60ddab7 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1453 microversion: 2.1 time: 0.150081 May 12 09:49:12.509405 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 573/1143] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:12 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:12.524949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-860ccc35-c0c5-4cce-b351-4b2e714f0373 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:12.525557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-860ccc35-c0c5-4cce-b351-4b2e714f0373 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:12.531743 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-860ccc35-c0c5-4cce-b351-4b2e714f0373 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:12.532196 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-860ccc35-c0c5-4cce-b351-4b2e714f0373 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:12.532955 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-860ccc35-c0c5-4cce-b351-4b2e714f0373 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:12.533392 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-860ccc35-c0c5-4cce-b351-4b2e714f0373 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:12.662104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-860ccc35-c0c5-4cce-b351-4b2e714f0373 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:12.669324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-860ccc35-c0c5-4cce-b351-4b2e714f0373 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1453 microversion: 2.1 time: 0.148140 May 12 09:49:12.669885 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 571/1144] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:49:12 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:49:14.318691 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-2ba0f0dc-b827-46b1-87c0-34f8b280507d req-64f046d1-a468-433e-ab86-e2c2697eff4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c701302e-c5c6-409c-9ec9-034448c9b961", "tag": "ba0739a1-e943-4513-865f-943e7ca3eba8"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:49:14.326817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-2ba0f0dc-b827-46b1-87c0-34f8b280507d req-64f046d1-a468-433e-ab86-e2c2697eff4c service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:14.327263 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-2ba0f0dc-b827-46b1-87c0-34f8b280507d req-64f046d1-a468-433e-ab86-e2c2697eff4c service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:14.338303 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-2ba0f0dc-b827-46b1-87c0-34f8b280507d req-64f046d1-a468-433e-ab86-e2c2697eff4c service nova] Creating event network-changed:ba0739a1-e943-4513-865f-943e7ca3eba8 for instance c701302e-c5c6-409c-9ec9-034448c9b961 on hv-cinder-83769 May 12 09:49:14.343237 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-2ba0f0dc-b827-46b1-87c0-34f8b280507d req-64f046d1-a468-433e-ab86-e2c2697eff4c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028187 May 12 09:49:14.343816 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 574/1145] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:49:39.207899 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5299fc11-55fd-4b8e-a950-fd5a888956dc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:39.208435 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5299fc11-55fd-4b8e-a950-fd5a888956dc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:39.214231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5299fc11-55fd-4b8e-a950-fd5a888956dc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:39.214677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5299fc11-55fd-4b8e-a950-fd5a888956dc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:39.215427 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5299fc11-55fd-4b8e-a950-fd5a888956dc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:39.215858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5299fc11-55fd-4b8e-a950-fd5a888956dc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:39.238809 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5299fc11-55fd-4b8e-a950-fd5a888956dc tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/ips" status: 200 len: 150 microversion: 2.20 time: 0.035010 May 12 09:49:39.239366 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 572/1146] 10.222.0.60 () {60 vars in 1288 bytes} [Thu May 12 09:49:39 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:49:41.003036 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-abbe74ac-822a-4656-af98-29f06b46fed1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:49:41.004269 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-abbe74ac-822a-4656-af98-29f06b46fed1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:41.010396 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-abbe74ac-822a-4656-af98-29f06b46fed1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:41.010844 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-abbe74ac-822a-4656-af98-29f06b46fed1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:41.011595 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-abbe74ac-822a-4656-af98-29f06b46fed1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:41.012029 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-abbe74ac-822a-4656-af98-29f06b46fed1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:41.033593 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-abbe74ac-822a-4656-af98-29f06b46fed1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lazy-loading 'flavor' on Instance uuid b7a27c8e-623a-4df5-9552-03cef9e9d0d7 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:49:41.285524 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-abbe74ac-822a-4656-af98-29f06b46fed1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/action" status: 202 len: 0 microversion: 2.20 time: 0.287108 May 12 09:49:41.286346 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 575/1147] 10.222.0.60 () {62 vars in 1318 bytes} [Thu May 12 09:49:40 2022] POST /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 09:49:41.295285 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:41.295901 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:41.303049 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:41.303652 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:41.305174 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:41.305660 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:41.436491 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:41.444105 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:41.445598 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:41.446772 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e76dd3f6-e3ec-4234-84d2-ce9a5d88aa55 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.155802 May 12 09:49:41.447327 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 573/1148] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:41 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:42.466153 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:42.466756 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:42.472898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:42.473347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:42.474129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:42.474561 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:42.598652 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:42.606258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:42.607757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:42.608900 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7c035e64-44eb-45d5-91da-b5d7a5755ae9 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.147615 May 12 09:49:42.609460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 576/1149] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:42 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:43.628757 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:43.629342 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:43.635670 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:43.636118 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:43.636879 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:43.637312 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:43.763191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:43.771715 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:43.773221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:43.774392 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-7d0318d9-c31d-4c3e-9f08-314f94df8c80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.150096 May 12 09:49:43.774949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 574/1150] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:43 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:44.792670 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:44.793261 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:44.799880 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:44.800482 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:44.801280 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:44.801804 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:44.931503 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:44.939297 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:44.941539 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:44.942710 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-136a04c6-83d7-4abf-87a9-97ff69ae79a5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.154024 May 12 09:49:44.943266 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 577/1151] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:44 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:45.960812 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:45.961416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:45.967460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:45.967912 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:45.968670 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:45.969106 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:46.098286 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:46.106681 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:46.108233 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:46.109490 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-593de85e-c243-43c0-add6-0695b37b6f60 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.152730 May 12 09:49:46.110061 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 575/1152] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:45 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:47.127467 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:47.128088 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:47.134855 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:47.135301 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:47.136054 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:47.136486 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:47.262220 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:47.270168 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:47.271659 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:47.272836 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6fc98a46-f6c6-45b5-ba44-bad08b730f52 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.149302 May 12 09:49:47.273393 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 578/1153] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:47 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:48.290987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:48.291619 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:48.297837 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:48.298307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:48.299055 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:48.299485 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:48.422814 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:48.430956 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:48.432540 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:48.433669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ac014116-fb0e-40fa-9cd2-e0f403e9f425 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.146617 May 12 09:49:48.434255 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 576/1154] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:48 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:49.452240 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:49.453070 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:49.459809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:49.460255 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:49.461021 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:49.461454 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:49.601757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:49.609541 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:49.611059 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:49.612214 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c07a0e64-8151-485e-b220-17722de67cd5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.164029 May 12 09:49:49.613171 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 579/1155] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:49 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:50.632565 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:50.633175 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:50.639656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:50.640365 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:50.641131 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:50.641565 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:50.763986 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:50.773149 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:50.774689 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:50.775836 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-cc465d0f-1111-4cbd-9a68-6eb56497f74a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.147270 May 12 09:49:50.776395 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 577/1156] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:50 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:51.794868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:51.795453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:51.802346 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:51.802790 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:51.803553 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:51.803991 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:51.931527 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:51.939279 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:51.941020 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:51.942195 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-eb650565-e4a6-4b65-af91-38349cdb5b38 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.151202 May 12 09:49:51.942754 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 580/1157] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:51 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:52.960312 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:52.960992 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:52.967121 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:52.967565 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:52.968318 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:52.968747 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:53.093551 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:53.101457 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:53.103003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:53.104153 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b06adc76-aedc-40db-bb95-f4b0a510adc3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.147783 May 12 09:49:53.104703 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 578/1158] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:52 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:54.122757 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:54.123455 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:54.130340 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:54.130855 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:54.131617 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:54.132051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:54.324016 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:54.331849 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:54.333342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:54.334515 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2ff3696a-f369-44f8-88fb-5c1801a99187 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.215652 May 12 09:49:54.335076 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 581/1159] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:54 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:55.353204 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:55.353772 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:55.360129 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:55.360578 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:55.361337 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:55.361773 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:55.488565 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:55.496193 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:55.497688 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:55.498866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8cb723b6-8bd8-4178-8293-86fd9157d554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.149648 May 12 09:49:55.499424 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 579/1160] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:55 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:56.517646 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:56.518308 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:56.525376 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:56.525822 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:56.526641 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:56.527100 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:56.649535 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:56.657158 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:56.658664 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:56.660359 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-312c0c1e-5208-4998-857a-b080eb00a9e5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.147057 May 12 09:49:56.660913 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 582/1161] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:56 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:57.678661 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:57.679249 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:57.685477 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:57.685938 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:57.686693 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:57.687123 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:57.815810 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:57.823534 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:57.825021 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:57.826190 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-80a0976f-f063-4bab-9994-21fa16cdc165 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.152084 May 12 09:49:57.827010 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 580/1162] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:57 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:49:58.844445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:49:58.845041 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:49:58.851498 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:58.851948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:58.852709 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:49:58.853145 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:49:58.977738 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:58.985371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:58.986894 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:49:58.988633 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-146ac4b5-6281-408f-833f-a8832c29b61a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1744 microversion: 2.20 time: 0.148138 May 12 09:49:58.989200 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 583/1163] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:49:58 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:00.016543 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:00.017148 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:00.024179 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:00.024640 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:00.025417 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:00.025859 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:00.157186 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:00.165001 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:00.166521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:00.167674 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-0d3b8e40-5f2c-4123-893d-976bdd57e111 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1744 microversion: 2.20 time: 0.155358 May 12 09:50:00.168229 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 581/1164] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:00 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:01.186249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:01.186856 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:01.193149 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:01.193597 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:01.194396 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:01.194869 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:01.319893 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:01.327501 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:01.329001 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:01.330189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-aacc7e5c-dc5b-4762-9a8f-c11fbdbc7483 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1744 microversion: 2.20 time: 0.147774 May 12 09:50:01.330747 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 584/1165] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:01 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:02.061951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-710f2ca9-9166-452d-bd47-fe5222da8377 req-f681fcc9-e545-4433-8b2f-e6bb93d04698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a27c8e-623a-4df5-9552-03cef9e9d0d7", "name": "network-vif-plugged", "status": "completed", "tag": "44a51ff9-5482-46c9-a3f0-25e1a93e8a55"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:50:02.070704 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-710f2ca9-9166-452d-bd47-fe5222da8377 req-f681fcc9-e545-4433-8b2f-e6bb93d04698 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:02.071148 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-710f2ca9-9166-452d-bd47-fe5222da8377 req-f681fcc9-e545-4433-8b2f-e6bb93d04698 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:02.082031 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-710f2ca9-9166-452d-bd47-fe5222da8377 req-f681fcc9-e545-4433-8b2f-e6bb93d04698 service nova] Creating event network-vif-plugged:44a51ff9-5482-46c9-a3f0-25e1a93e8a55 for instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 on hv-cinder-83769 May 12 09:50:02.087338 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-710f2ca9-9166-452d-bd47-fe5222da8377 req-f681fcc9-e545-4433-8b2f-e6bb93d04698 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029261 May 12 09:50:02.088226 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 582/1166] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:50:02.349060 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:02.349655 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:02.355929 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:02.356370 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:02.357121 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:02.357553 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:02.480550 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:02.488793 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:02.490312 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:02.491463 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-4696082e-5bdf-40f9-96eb-3039ace0eba3 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1744 microversion: 2.20 time: 0.146837 May 12 09:50:02.492023 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 585/1167] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:02 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1744 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:03.511155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:03.512148 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:03.518556 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:03.518999 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:03.519885 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:03.520305 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:03.646847 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:03.654379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:03.655866 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:03.657002 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c444ed42-d73f-4b93-adc6-cc0452f08a46 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1744 microversion: 2.20 time: 0.150883 May 12 09:50:03.657551 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 583/1168] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:03 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:04.675313 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:04.676001 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:04.682546 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:04.682999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:04.683800 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:04.684239 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:04.819188 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:04.829619 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:04.831162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:04.832325 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-b00fb123-bb0a-4a0b-8745-52c56f9d0740 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.160944 May 12 09:50:04.842058 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 586/1169] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:04 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:05.852523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:05.853876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:05.860874 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:05.861327 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:05.862173 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:05.862831 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:06.005787 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:06.013975 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:06.016099 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:06.017277 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-758bc05d-e971-4c74-96cb-2ed4df6cbd88 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.169610 May 12 09:50:06.017845 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 584/1170] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:05 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:07.037043 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:07.038347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:07.044920 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:07.045635 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:07.046460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:07.046945 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:07.197997 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:07.208835 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:07.211025 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:07.212817 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f864e752-c0fa-4685-8664-d9cd236a16b7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.180092 May 12 09:50:07.213378 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 587/1171] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:07 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:08.234321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:08.234934 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:08.244187 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:08.244343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:08.245123 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:08.245557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:08.391659 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:08.401433 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:08.403019 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:08.404748 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8a0bbeef-836c-42a3-a5b7-b23681946969 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.174466 May 12 09:50:08.405366 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 585/1172] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:08 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:09.427680 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:09.428281 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:09.436959 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:09.437597 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:09.438586 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:09.439245 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:09.585867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:09.594962 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:09.598747 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:09.600286 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3fb06445-f25d-43de-b910-cadfac3d1ca6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.178715 May 12 09:50:09.614381 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 588/1173] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:09 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:10.623122 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:10.623823 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:10.634738 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:10.635236 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:10.637026 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:10.637324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:10.772665 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:10.780915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:10.782488 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:10.783673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-b36c7540-c2ac-4f16-8550-9248f2a8ed12 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.165260 May 12 09:50:10.785067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 586/1174] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:10 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:11.803495 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:11.804759 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:11.811248 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:11.811705 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:11.812476 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:11.812920 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:11.950928 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:11.958998 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:11.960868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:11.962074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e0122f26-d543-4027-9e1e-8aa48d070ccf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.163421 May 12 09:50:11.962942 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 589/1175] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:11 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:12.980363 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:12.981304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:12.989104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:12.989560 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:12.990363 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:12.990971 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:13.142271 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:13.153588 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:13.155918 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:13.157145 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-97e3b800-1f97-4025-8640-3b8951b85469 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.180673 May 12 09:50:13.168612 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 587/1176] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:12 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:14.179172 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:14.180288 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:14.186410 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:14.186864 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:14.187628 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:14.188071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:14.342916 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:14.351919 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:14.353523 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:14.354806 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-328eabdc-7736-40e3-a63c-8907e932de79 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.181631 May 12 09:50:14.355632 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 590/1177] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:14 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:15.372686 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:15.373220 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:15.379317 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:15.379771 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:15.380538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:15.380978 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:15.504911 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:15.512601 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:15.514140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:15.515552 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a80d0e93-56a6-4325-ae14-fcc5f036ef43 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1739 microversion: 2.20 time: 0.146630 May 12 09:50:15.516159 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 588/1178] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:15 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1739 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:16.534250 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:16.534860 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:16.541177 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:16.541642 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:16.542453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:16.542892 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:16.669408 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:16.677420 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:16.678932 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:16.680071 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-1730c4c5-06aa-4215-b2cf-e570e17882bb tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1721 microversion: 2.20 time: 0.149778 May 12 09:50:16.680624 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 591/1179] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:16 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:17.698924 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:17.699516 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:17.706370 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:17.706829 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:17.707590 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:17.708025 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:17.837483 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:17.845058 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:17.847075 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:17.848214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6017bd3c-7398-4c71-83cc-df4ea6d49a27 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1721 microversion: 2.20 time: 0.153219 May 12 09:50:17.848763 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 589/1180] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:17 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:18.083636 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-e7ec0841-27a5-4b9e-89f5-5cc3bae14ca6 req-4bda27d5-285e-4934-b895-53df9c92a387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a27c8e-623a-4df5-9552-03cef9e9d0d7", "name": "network-vif-unplugged", "status": "completed", "tag": "44a51ff9-5482-46c9-a3f0-25e1a93e8a55"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:50:18.097616 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-e7ec0841-27a5-4b9e-89f5-5cc3bae14ca6 req-4bda27d5-285e-4934-b895-53df9c92a387 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:18.098789 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-e7ec0841-27a5-4b9e-89f5-5cc3bae14ca6 req-4bda27d5-285e-4934-b895-53df9c92a387 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:18.113771 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-e7ec0841-27a5-4b9e-89f5-5cc3bae14ca6 req-4bda27d5-285e-4934-b895-53df9c92a387 service nova] Creating event network-vif-unplugged:44a51ff9-5482-46c9-a3f0-25e1a93e8a55 for instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 on hv-cinder-83769 May 12 09:50:18.120379 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-e7ec0841-27a5-4b9e-89f5-5cc3bae14ca6 req-4bda27d5-285e-4934-b895-53df9c92a387 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041254 May 12 09:50:18.122786 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 592/1181] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:50:18.867095 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:18.867710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:18.874111 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:18.874576 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:18.875343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:18.875784 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:18.999227 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:19.007573 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:19.009149 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:19.010358 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ce9dd233-32f5-4031-ad25-e997e290c005 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1664 microversion: 2.20 time: 0.147212 May 12 09:50:19.010922 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 590/1182] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:18 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:19.028492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2cc8c238-fa11-4be9-9032-49d11d2ea554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3024d722-6b12-4fb5-8083-63b463fd9eca"}} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:50:19.029653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2cc8c238-fa11-4be9-9032-49d11d2ea554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:19.035648 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2cc8c238-fa11-4be9-9032-49d11d2ea554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:19.036093 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2cc8c238-fa11-4be9-9032-49d11d2ea554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:19.036848 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2cc8c238-fa11-4be9-9032-49d11d2ea554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:19.037283 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2cc8c238-fa11-4be9-9032-49d11d2ea554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:19.288851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2cc8c238-fa11-4be9-9032-49d11d2ea554 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.264553 May 12 09:50:19.289507 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 593/1183] 10.222.0.60 () {62 vars in 1363 bytes} [Thu May 12 09:50:19 2022] POST /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/os-volume_attachments => generated 188 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 09:50:19.398165 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a9ffa194-276a-44b4-9109-585eddf6ae37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:19.398675 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a9ffa194-276a-44b4-9109-585eddf6ae37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:19.404380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a9ffa194-276a-44b4-9109-585eddf6ae37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:19.404829 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a9ffa194-276a-44b4-9109-585eddf6ae37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:19.405591 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a9ffa194-276a-44b4-9109-585eddf6ae37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:19.406194 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a9ffa194-276a-44b4-9109-585eddf6ae37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:19.636951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a9ffa194-276a-44b4-9109-585eddf6ae37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/os-volume_attachments/3024d722-6b12-4fb5-8083-63b463fd9eca" status: 202 len: 0 microversion: 2.20 time: 0.242551 May 12 09:50:19.640770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 591/1184] 10.222.0.60 () {60 vars in 1456 bytes} [Thu May 12 09:50:19 2022] DELETE /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/os-volume_attachments/3024d722-6b12-4fb5-8083-63b463fd9eca => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 09:50:19.693404 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-8c9d9088-9ce1-4ce7-92c1-a96ea4691fa2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:50:19.694015 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-8c9d9088-9ce1-4ce7-92c1-a96ea4691fa2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:19.699799 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8c9d9088-9ce1-4ce7-92c1-a96ea4691fa2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:19.700246 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8c9d9088-9ce1-4ce7-92c1-a96ea4691fa2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:19.700999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8c9d9088-9ce1-4ce7-92c1-a96ea4691fa2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:19.701434 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-8c9d9088-9ce1-4ce7-92c1-a96ea4691fa2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:19.794040 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-8c9d9088-9ce1-4ce7-92c1-a96ea4691fa2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "POST /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/action" status: 202 len: 0 microversion: 2.20 time: 0.104470 May 12 09:50:19.794822 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 594/1185] 10.222.0.60 () {62 vars in 1318 bytes} [Thu May 12 09:50:19 2022] POST /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 09:50:19.802680 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:19.803284 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:19.809200 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:19.809649 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:19.810448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:19.810883 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:19.942626 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:19.950249 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:19.952096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:19.953444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d4b61f13-d8e5-4c15-9eb9-66d9177d6b71 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1672 microversion: 2.20 time: 0.154724 May 12 09:50:19.954014 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 592/1186] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:19 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:20.973164 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:20.974004 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:20.980873 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:20.981347 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:20.982166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:20.982674 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:21.110225 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:21.118007 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:21.119499 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:21.120649 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6371728b-9788-485f-93c5-9f8c384e8cb0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.152558 May 12 09:50:21.121249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 595/1187] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:20 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:22.139128 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:22.139656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:22.146221 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:22.146667 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:22.147429 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:22.147858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:22.278088 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:22.286573 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:22.288096 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:22.289258 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e50176ad-f089-47e5-b293-4c6372701c74 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.154120 May 12 09:50:22.289815 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 593/1188] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:22 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:23.308160 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:23.308778 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:23.316074 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:23.316639 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:23.317837 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:23.318365 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:23.451192 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:23.458933 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:23.460418 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:23.461585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9a414ab9-e7d4-4dec-b988-f938490d40e2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.157401 May 12 09:50:23.462165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 596/1189] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:23 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:24.480058 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:24.480690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:24.488463 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:24.489191 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:24.490310 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:24.490744 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:24.632106 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:24.640014 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:24.641797 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:24.643153 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-ba7a38e9-6369-4b51-9443-21777f61a6e1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.167067 May 12 09:50:24.643716 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 594/1190] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:24 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:25.660698 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:25.662119 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:25.669108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:25.669923 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:25.670954 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:25.671623 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:25.810451 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:25.819103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:25.820595 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:25.822115 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e2103db7-03fc-4cc7-8025-80b0a824619a tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.165242 May 12 09:50:25.822764 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 597/1191] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:25 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:26.840539 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:26.841284 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:26.847777 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:26.848231 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:26.849020 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:26.849456 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:26.987851 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:26.995867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:26.997393 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:26.998581 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f2d40d3c-0801-4fe0-a2e2-ff27f8e8f5d5 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.161976 May 12 09:50:26.999339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 595/1192] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:26 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:28.016731 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:28.018192 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:28.025202 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:28.025650 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:28.026461 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:28.026900 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:28.187029 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:28.195722 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:28.196643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:28.197820 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-beea9da6-5880-4aea-bdb3-e3856e419605 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.185230 May 12 09:50:28.198414 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 598/1193] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:28 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:29.216692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:29.217317 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:29.225255 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:29.225732 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:29.226990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:29.226990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:29.367397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:29.375466 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:29.376970 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:29.378727 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-efb547f0-f6c4-41ec-a6cd-dd49700d6dcf tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.166086 May 12 09:50:29.379628 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 596/1194] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:29 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:30.397059 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:30.397674 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:30.404003 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:30.404453 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:30.405212 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:30.405648 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:30.528244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:30.533835 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:50:30.534060 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Thu May 12 09:50:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 (ip 10.222.0.60) !!! May 12 09:50:30.537653 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:30.540390 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:30.542328 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-43042456-f37c-411d-a28a-a9f070f6f1b6 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.149657 May 12 09:50:30.543706 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 599/1195] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:30 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:31.561412 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:31.562092 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:31.568372 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:31.568825 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:31.569586 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:31.570057 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:31.695512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:31.703093 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:31.704578 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:31.706240 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-d82d31cc-8cad-41bc-ac69-4e36fc409f19 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.148801 May 12 09:50:31.706805 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 597/1196] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:31 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:32.725233 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:32.725815 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:32.732064 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:32.732500 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:32.733247 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:32.733677 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:32.856300 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:32.864431 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:32.865934 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:32.867062 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-dcf40f7e-7a4c-4ca9-9186-3b7df92d7da0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.146307 May 12 09:50:32.867613 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 600/1197] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:32 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:33.885275 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:33.885877 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:33.892359 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:33.892804 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:33.893559 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:33.894021 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:34.016052 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:34.023643 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:34.025128 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:34.026291 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-96c48517-2ca1-4086-b267-b4a4564bb56c tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.144907 May 12 09:50:34.026849 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 598/1198] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:33 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:35.044485 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:35.045076 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:35.051452 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:35.051898 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:35.052651 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:35.053080 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:35.181089 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:35.188947 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:35.190492 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:35.192285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-36a4bad5-e458-4a0d-beca-305b78270fa1 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.151700 May 12 09:50:35.192850 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 601/1199] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:35 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:36.210950 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:36.211596 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:36.217816 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:36.218297 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:36.219059 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:36.219495 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:36.347552 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:36.355294 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:36.356789 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:36.357960 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-340e8eb2-5705-4688-9890-fbe101999b8e tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.151427 May 12 09:50:36.358524 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 599/1200] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:36 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:37.376315 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:37.376860 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:37.383149 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:37.383592 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:37.384351 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:37.384784 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:37.520857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:37.528507 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:37.530033 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:37.531181 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-542b0fbd-1e05-430c-94f7-b107f8503a37 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.158904 May 12 09:50:37.531734 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 602/1201] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:37 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:38.232677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-90b3f5c8-761f-42d0-a792-a82aed4adf93 req-89840981-6d86-451d-8b91-a85e28c4a218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a27c8e-623a-4df5-9552-03cef9e9d0d7", "name": "network-vif-plugged", "status": "completed", "tag": "44a51ff9-5482-46c9-a3f0-25e1a93e8a55"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:50:38.241869 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-90b3f5c8-761f-42d0-a792-a82aed4adf93 req-89840981-6d86-451d-8b91-a85e28c4a218 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:38.242431 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-90b3f5c8-761f-42d0-a792-a82aed4adf93 req-89840981-6d86-451d-8b91-a85e28c4a218 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:38.253224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-90b3f5c8-761f-42d0-a792-a82aed4adf93 req-89840981-6d86-451d-8b91-a85e28c4a218 service nova] Creating event network-vif-plugged:44a51ff9-5482-46c9-a3f0-25e1a93e8a55 for instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 on hv-cinder-83769 May 12 09:50:38.258813 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-90b3f5c8-761f-42d0-a792-a82aed4adf93 req-89840981-6d86-451d-8b91-a85e28c4a218 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029785 May 12 09:50:38.259390 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 600/1202] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:50:38.550078 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:38.550688 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:38.557520 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:38.558010 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:38.558773 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:38.559228 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:38.682913 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:38.690555 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:38.692052 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:38.693203 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5207e28b-0c14-4e6d-a2bd-607638ab8f62 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.147058 May 12 09:50:38.693760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 603/1203] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:38 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:39.658724 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection May 12 09:50:39.659356 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Thu May 12 09:50:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:50:39.712461 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:39.713149 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:39.721876 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:39.722376 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:39.723775 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:39.724189 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:39.850877 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:39.858557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:39.860110 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:39.861260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-11b20731-f70a-4620-97ec-4966fc482135 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1730 microversion: 2.20 time: 0.153876 May 12 09:50:39.861811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 601/1204] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:39 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:50:40.879841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:50:40.880448 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:50:40.886536 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:40.887017 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:40.887786 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:50:40.888211 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:50:41.012038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:41.020051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:41.021546 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:50:41.022721 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-635ccc49-2fd3-4275-824a-852b9d73920d tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1717 microversion: 2.20 time: 0.146815 May 12 09:50:41.023274 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 604/1205] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:50:40 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1717 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:51:36.393696 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-70899d57-1655-4c10-954d-f10cbea55de0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:36.394678 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-70899d57-1655-4c10-954d-f10cbea55de0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:36.401260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70899d57-1655-4c10-954d-f10cbea55de0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:36.401710 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70899d57-1655-4c10-954d-f10cbea55de0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:36.402505 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70899d57-1655-4c10-954d-f10cbea55de0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:36.402943 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70899d57-1655-4c10-954d-f10cbea55de0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:36.430779 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-70899d57-1655-4c10-954d-f10cbea55de0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041338 May 12 09:51:36.431321 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 602/1206] 10.222.0.60 () {60 vars in 1342 bytes} [Thu May 12 09:51:36 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:36.487624 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e9bbc422-3d37-4319-bd46-62cc89a89e13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:36.488117 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e9bbc422-3d37-4319-bd46-62cc89a89e13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:36.494065 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9bbc422-3d37-4319-bd46-62cc89a89e13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:36.494507 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9bbc422-3d37-4319-bd46-62cc89a89e13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:36.495258 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9bbc422-3d37-4319-bd46-62cc89a89e13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:36.495687 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e9bbc422-3d37-4319-bd46-62cc89a89e13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:36.519831 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e9bbc422-3d37-4319-bd46-62cc89a89e13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:51:36.591341 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e9bbc422-3d37-4319-bd46-62cc89a89e13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 204 len: 0 microversion: 2.20 time: 0.107239 May 12 09:51:36.592216 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 605/1207] 10.222.0.60 () {60 vars in 1279 bytes} [Thu May 12 09:51:36 2022] DELETE /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 09:51:36.600547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:36.601158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:36.607018 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:36.607471 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:36.608298 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:36.608668 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:36.732158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:36.739853 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:36.741350 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:36.742542 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-95a79210-5981-4e10-84f1-a4424d19e210 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.145949 May 12 09:51:36.743104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 603/1208] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:51:36 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:51:37.761705 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:37.762427 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:37.769069 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:37.769513 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:37.770306 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:37.770739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:37.894157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:37.902355 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:37.903864 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:37.905064 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e1e44375-85bb-4caa-b7be-a79e9857a8a7 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1723 microversion: 2.20 time: 0.147708 May 12 09:51:37.905630 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 606/1209] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:51:37 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:51:38.923366 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:38.923982 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:38.930981 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:38.931436 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:38.932205 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:38.932647 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:38.998124 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:39.005808 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:39.007378 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:39.008540 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-338a88b8-c78f-430c-905e-6cce30d43f6b tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1655 microversion: 2.20 time: 0.089131 May 12 09:51:39.009302 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 604/1210] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:51:38 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1655 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:51:39.064106 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2914a1d3-aead-4966-bedc-07c5422c482b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:39.065275 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2914a1d3-aead-4966-bedc-07c5422c482b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:39.089604 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2914a1d3-aead-4966-bedc-07c5422c482b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:39.091273 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2914a1d3-aead-4966-bedc-07c5422c482b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:39.093273 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2914a1d3-aead-4966-bedc-07c5422c482b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:39.097934 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2914a1d3-aead-4966-bedc-07c5422c482b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:39.132556 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2914a1d3-aead-4966-bedc-07c5422c482b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:51:39.146361 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-27866c0e-0fcc-448c-a47f-1bfc856ceb57 req-bae95f3c-1254-4ad1-9449-d39fde4368f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a27c8e-623a-4df5-9552-03cef9e9d0d7", "name": "network-vif-deleted", "tag": "44a51ff9-5482-46c9-a3f0-25e1a93e8a55"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:51:39.157675 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-27866c0e-0fcc-448c-a47f-1bfc856ceb57 req-bae95f3c-1254-4ad1-9449-d39fde4368f6 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:39.158149 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-27866c0e-0fcc-448c-a47f-1bfc856ceb57 req-bae95f3c-1254-4ad1-9449-d39fde4368f6 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:39.184861 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-27866c0e-0fcc-448c-a47f-1bfc856ceb57 req-bae95f3c-1254-4ad1-9449-d39fde4368f6 service nova] Creating event network-vif-deleted:44a51ff9-5482-46c9-a3f0-25e1a93e8a55 for instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 on hv-cinder-83769 May 12 09:51:39.199690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-27866c0e-0fcc-448c-a47f-1bfc856ceb57 req-bae95f3c-1254-4ad1-9449-d39fde4368f6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130461 May 12 09:51:39.203730 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 605/1211] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:51:39.243051 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2914a1d3-aead-4966-bedc-07c5422c482b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 204 len: 0 microversion: 2.1 time: 0.183338 May 12 09:51:39.246851 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 607/1212] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:51:39 2022] DELETE /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:51:39.255818 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-8941ba64-9aff-4dd4-9abc-b104f844f46a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:39.256627 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-8941ba64-9aff-4dd4-9abc-b104f844f46a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:39.263299 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8941ba64-9aff-4dd4-9abc-b104f844f46a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:39.263757 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8941ba64-9aff-4dd4-9abc-b104f844f46a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:39.264543 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8941ba64-9aff-4dd4-9abc-b104f844f46a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:39.264979 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-8941ba64-9aff-4dd4-9abc-b104f844f46a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:39.399568 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-8941ba64-9aff-4dd4-9abc-b104f844f46a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:39.407060 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-8941ba64-9aff-4dd4-9abc-b104f844f46a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1577 microversion: 2.1 time: 0.155869 May 12 09:51:39.407988 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 606/1213] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:39 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:40.027123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:40.027876 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:40.034276 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:40.034730 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:40.035501 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:40.035933 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:40.068836 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:40.069448 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:40.070327 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.objects.instance [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lazy-loading 'fault' on Instance uuid b7a27c8e-623a-4df5-9552-03cef9e9d0d7 {{(pid=123510) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 12 09:51:40.110697 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:40.118804 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:40.120287 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f739359acd844279aa56ef7d69f4c299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b879e240eb4f48139e28cc43223b21da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:40.121429 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-19f8bb5f-a31d-454d-958e-b36416c71e80 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 200 len: 1372 microversion: 2.20 time: 0.098819 May 12 09:51:40.122345 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 608/1214] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:51:40 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 09:51:40.424498 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-167ae5af-2034-410e-8c25-c297f2d24894 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:40.425196 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-167ae5af-2034-410e-8c25-c297f2d24894 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:40.432076 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-167ae5af-2034-410e-8c25-c297f2d24894 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:40.432521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-167ae5af-2034-410e-8c25-c297f2d24894 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:40.433324 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-167ae5af-2034-410e-8c25-c297f2d24894 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:40.433706 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-167ae5af-2034-410e-8c25-c297f2d24894 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:40.560533 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-167ae5af-2034-410e-8c25-c297f2d24894 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:40.567819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-167ae5af-2034-410e-8c25-c297f2d24894 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1577 microversion: 2.1 time: 0.147195 May 12 09:51:40.568380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 607/1215] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:40 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:41.139720 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:41.140730 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:41.147219 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:41.147707 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:41.149019 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:41.149460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:41.162695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] HTTP exception thrown: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Request method failure captured: May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 HTTP/1.1 May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNa2j2n104jiX9cXXMJgV4ejMNWv-yqx_Rv3irjrG2BAJoHwbnTNAEiT14QzzEJR6x1O9NcwKrmcGdkA-1TAu13QJmGV6PikZrzLUNQovL4CXWtdLeKxlsuBnPWx_h0TfAFFsCOi_XuzyQuRtxToj8Q4Ahre2-8im3yo7HKhDJIf6DY May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Openstack-Nova-Api-Version: 2.20 May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:51:41.164543 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b879e240eb4f48139e28cc43223b21da", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}] May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: f739359acd844279aa56ef7d69f4c299 May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:41.166443 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'b7a27c8e-623a-4df5-9552-03cef9e9d0d7'} May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:51:41.168828 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:41.170251 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:41.171454 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Returning 404 to user: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:51:41.171454 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-c5953fc7-b0ff-469f-a617-a8a07dbe9ac0 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 404 len: 111 microversion: 2.20 time: 0.030372 May 12 09:51:41.171454 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 609/1216] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:51:41 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 09:51:41.174858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-de124603-f2e7-4a6f-8965-79bdd4babca2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '.version_select at 0x7f872609e430>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:41.195464 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-de124603-f2e7-4a6f-8965-79bdd4babca2 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896670202" status: 204 len: 0 microversion: 2.20 time: 0.023945 May 12 09:51:41.196038 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 608/1217] 10.222.0.60 () {60 vars in 1261 bytes} [Thu May 12 09:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896670202 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 09:51:41.584097 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-39d9e4ac-6e5f-4aef-a0d6-77735417387a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:41.585069 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-39d9e4ac-6e5f-4aef-a0d6-77735417387a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:41.591701 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39d9e4ac-6e5f-4aef-a0d6-77735417387a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:41.592259 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39d9e4ac-6e5f-4aef-a0d6-77735417387a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:41.593311 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39d9e4ac-6e5f-4aef-a0d6-77735417387a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:41.593939 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-39d9e4ac-6e5f-4aef-a0d6-77735417387a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:41.820798 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-39d9e4ac-6e5f-4aef-a0d6-77735417387a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:41.833009 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-39d9e4ac-6e5f-4aef-a0d6-77735417387a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 200 len: 1577 microversion: 2.1 time: 0.252720 May 12 09:51:41.833750 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 610/1218] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:41 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:42.043392 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-bdd4faec-3c2b-432f-a66d-329b6d122673 req-0f067a3a-51e4-4e34-9a79-f025d7424c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c701302e-c5c6-409c-9ec9-034448c9b961", "name": "network-vif-deleted", "tag": "ba0739a1-e943-4513-865f-943e7ca3eba8"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:51:42.052538 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-bdd4faec-3c2b-432f-a66d-329b6d122673 req-0f067a3a-51e4-4e34-9a79-f025d7424c00 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:42.052987 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-bdd4faec-3c2b-432f-a66d-329b6d122673 req-0f067a3a-51e4-4e34-9a79-f025d7424c00 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:42.064690 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-bdd4faec-3c2b-432f-a66d-329b6d122673 req-0f067a3a-51e4-4e34-9a79-f025d7424c00 service nova] Creating event network-vif-deleted:ba0739a1-e943-4513-865f-943e7ca3eba8 for instance c701302e-c5c6-409c-9ec9-034448c9b961 on hv-cinder-83769 May 12 09:51:42.070208 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-bdd4faec-3c2b-432f-a66d-329b6d122673 req-0f067a3a-51e4-4e34-9a79-f025d7424c00 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030345 May 12 09:51:42.070905 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 609/1219] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:51:42.850558 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:42.851702 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:42.858196 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:42.858655 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:42.859471 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:42.859914 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:42.874438 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] HTTP exception thrown: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Request method failure captured: May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 HTTP/1.1 May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNfsSGsklBQKgk2wz8_ns-oseYoeHnatXieF61uEo04yoCIDDZKrFK_4jpXSpv7-HLuPhwt0xwYvCRti6WGSjN25z8DetSurOaNBy0sexdbNJZUaLgjgrV3DHCZ6xyyT3ZOQrkR8uN1tbFWv-U40qZcBt0phwgL5wwmpUUmQcJorimM May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: 6e6bc2241970493783de557e3f690105 May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:51:42.876108 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e6bc2241970493783de557e3f690105", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e6bc2241970493783de557e3f690105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}] May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-TestVolumeBootPattern-1342689768 May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: 6e6bc2241970493783de557e3f690105 May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-TestVolumeBootPattern-1342689768-project May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 06be00f6a9ad465195c7606883b4160d May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-TestVolumeBootPattern-1342689768-project May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:51:42.877762 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'c701302e-c5c6-409c-9ec9-034448c9b961'} May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:51:42.878727 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:51:42.880244 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:42.881605 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Returning 404 to user: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:51:42.881605 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f2cf1eb5-bb1f-401b-b5c5-39de304685e2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 404 len: 111 microversion: 2.1 time: 0.030955 May 12 09:51:42.881605 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 611/1220] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:42 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:51:42.927468 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-62362248", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-744304972", "security_groups": [{"name": "tempest-secgroup-smoke-176244007"}], "block_device_mapping_v2": [{"uuid": "7296c798-58f7-4a30-893e-f78197c2aa10", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6f9b602-5994-4479-ba8e-6005a9bbaa39"}]}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:51:42.987834 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:42.988761 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:42.994843 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:42.995300 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:42.996352 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:42.996796 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:43.010865 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] HTTP exception thrown: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Request method failure captured: May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: DELETE /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 HTTP/1.1 May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNa2j2n104jiX9cXXMJgV4ejMNWv-yqx_Rv3irjrG2BAJoHwbnTNAEiT14QzzEJR6x1O9NcwKrmcGdkA-1TAu13QJmGV6PikZrzLUNQovL4CXWtdLeKxlsuBnPWx_h0TfAFFsCOi_XuzyQuRtxToj8Q4Ahre2-8im3yo7HKhDJIf6DY May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Openstack-Nova-Api-Version: 2.20 May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:51:43.012442 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b879e240eb4f48139e28cc43223b21da", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}] May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: f739359acd844279aa56ef7d69f4c299 May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.014206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'b7a27c8e-623a-4df5-9552-03cef9e9d0d7'} May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:51:43.015045 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.016658 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.019344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Returning 404 to user: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:51:43.019344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-bb339d55-f628-4e9a-8de0-40a9610af687 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 404 len: 111 microversion: 2.20 time: 0.029928 May 12 09:51:43.019344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 612/1221] 10.222.0.60 () {60 vars in 1279 bytes} [Thu May 12 09:51:42 2022] DELETE /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 09:51:43.023339 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:43.023957 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: b7a27c8e-623a-4df5-9552-03cef9e9d0d7] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:43.030129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:43.030573 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:43.031572 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:43.032198 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:43.047182 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] HTTP exception thrown: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.048649 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] validate_networks() for [('f6f9b602-5994-4479-ba8e-6005a9bbaa39', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Request method failure captured: May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 HTTP/1.1 May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNa2j2n104jiX9cXXMJgV4ejMNWv-yqx_Rv3irjrG2BAJoHwbnTNAEiT14QzzEJR6x1O9NcwKrmcGdkA-1TAu13QJmGV6PikZrzLUNQovL4CXWtdLeKxlsuBnPWx_h0TfAFFsCOi_XuzyQuRtxToj8Q4Ahre2-8im3yo7HKhDJIf6DY May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Openstack-Nova-Api-Version: 2.20 May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:51:43.049084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b879e240eb4f48139e28cc43223b21da", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}] May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: f739359acd844279aa56ef7d69f4c299 May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.050599 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'b7a27c8e-623a-4df5-9552-03cef9e9d0d7'} May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:51:43.051760 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. May 12 09:51:43.053046 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:43.055234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Returning 404 to user: Instance b7a27c8e-623a-4df5-9552-03cef9e9d0d7 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:51:43.055234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-7bb3cca2-a289-483b-9902-ede996663a22 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7" status: 404 len: 111 microversion: 2.20 time: 0.031300 May 12 09:51:43.055234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 613/1222] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:51:43 2022] GET /compute/v2.1/servers/b7a27c8e-623a-4df5-9552-03cef9e9d0d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 09:51:43.495140 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:51:43.495584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:51:43.496047 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:51:43.496446 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:51:43.496848 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:51:43.505182 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:43.505620 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:43.506445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:43.506877 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:43.524462 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Getting quotas for project 6e6bc2241970493783de557e3f690105. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:51:43.528281 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Getting quotas for user 06be00f6a9ad465195c7606883b4160d and project 6e6bc2241970493783de557e3f690105. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:51:43.582125 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:51:43.584339 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7296c798-58f7-4a30-893e-f78197c2aa10',volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:51:43.704354 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4611b2f9-4f37-4828-a659-8140f7926167 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.781217 May 12 09:51:43.704993 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 610/1223] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:51:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:51:43.714916 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e1723445-5b72-4f5a-a409-5e33d270215b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:43.715608 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e1723445-5b72-4f5a-a409-5e33d270215b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:43.768591 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e1723445-5b72-4f5a-a409-5e33d270215b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:43.775191 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e1723445-5b72-4f5a-a409-5e33d270215b tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1092 microversion: 2.1 time: 0.064126 May 12 09:51:43.775671 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 614/1224] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:43 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1092 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:44.191973 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:44.192474 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:44.198614 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:44.199071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:44.199837 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:44.200278 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:44.213511 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] HTTP exception thrown: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Request method failure captured: May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: DELETE /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf HTTP/1.1 May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNa2j2n104jiX9cXXMJgV4ejMNWv-yqx_Rv3irjrG2BAJoHwbnTNAEiT14QzzEJR6x1O9NcwKrmcGdkA-1TAu13QJmGV6PikZrzLUNQovL4CXWtdLeKxlsuBnPWx_h0TfAFFsCOi_XuzyQuRtxToj8Q4Ahre2-8im3yo7HKhDJIf6DY May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Openstack-Nova-Api-Version: 2.20 May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:51:44.215241 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b879e240eb4f48139e28cc43223b21da", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}] May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: f739359acd844279aa56ef7d69f4c299 May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.216959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '18552b7d-9ecc-4182-b0fd-726899815dcf'} May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:51:44.217933 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.219521 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:44.221307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Returning 404 to user: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:51:44.221307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6f8e9ee6-61d5-4950-be9a-d523c2e49893 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "DELETE /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 404 len: 111 microversion: 2.20 time: 0.028985 May 12 09:51:44.221307 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 611/1225] 10.222.0.60 () {60 vars in 1279 bytes} [Thu May 12 09:51:44 2022] DELETE /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 09:51:44.227138 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:44.227940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] [instance: 18552b7d-9ecc-4182-b0fd-726899815dcf] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:44.235841 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:44.236436 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:44.237538 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:44.238079 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:44.252855 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] HTTP exception thrown: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Request method failure captured: May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf HTTP/1.1 May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNa2j2n104jiX9cXXMJgV4ejMNWv-yqx_Rv3irjrG2BAJoHwbnTNAEiT14QzzEJR6x1O9NcwKrmcGdkA-1TAu13QJmGV6PikZrzLUNQovL4CXWtdLeKxlsuBnPWx_h0TfAFFsCOi_XuzyQuRtxToj8Q4Ahre2-8im3yo7HKhDJIf6DY May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Openstack-Nova-Api-Version: 2.20 May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:51:44.254449 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_b879e240eb4f48139e28cc43223b21da", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/b879e240eb4f48139e28cc43223b21da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/b879e240eb4f48139e28cc43223b21da"}]}] May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: b879e240eb4f48139e28cc43223b21da May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1639766459 May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: f739359acd844279aa56ef7d69f4c299 May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1639766459-project May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.256173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': '18552b7d-9ecc-4182-b0fd-726899815dcf'} May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:51:44.257123 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. May 12 09:51:44.258739 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:51:44.260173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] Returning 404 to user: Instance 18552b7d-9ecc-4182-b0fd-726899815dcf could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:51:44.260173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-ecb583a4-28f0-4ac2-acc4-289cf33bdc13 tempest-AttachVolumeShelveTestJSON-1639766459 tempest-AttachVolumeShelveTestJSON-1639766459-project] 10.222.0.60 "GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf" status: 404 len: 111 microversion: 2.20 time: 0.033521 May 12 09:51:44.260173 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 615/1226] 10.222.0.60 () {60 vars in 1276 bytes} [Thu May 12 09:51:44 2022] GET /compute/v2.1/servers/18552b7d-9ecc-4182-b0fd-726899815dcf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 09:51:44.792914 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9503b687-4753-414a-8409-f2efc2cc5ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:44.793520 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9503b687-4753-414a-8409-f2efc2cc5ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:44.799518 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9503b687-4753-414a-8409-f2efc2cc5ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:44.800158 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9503b687-4753-414a-8409-f2efc2cc5ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:44.801114 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9503b687-4753-414a-8409-f2efc2cc5ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:44.801722 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9503b687-4753-414a-8409-f2efc2cc5ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:45.174998 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9503b687-4753-414a-8409-f2efc2cc5ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:45.184019 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9503b687-4753-414a-8409-f2efc2cc5ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1208 microversion: 2.1 time: 0.395498 May 12 09:51:45.184847 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 612/1227] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:44 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1208 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:46.206215 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-04e5065f-6e04-456d-8556-8acb1ba68278 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:46.206830 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-04e5065f-6e04-456d-8556-8acb1ba68278 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:46.214129 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-04e5065f-6e04-456d-8556-8acb1ba68278 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:46.214807 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-04e5065f-6e04-456d-8556-8acb1ba68278 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:46.216162 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-04e5065f-6e04-456d-8556-8acb1ba68278 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:46.216754 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-04e5065f-6e04-456d-8556-8acb1ba68278 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:46.536323 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-04e5065f-6e04-456d-8556-8acb1ba68278 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:46.558238 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-f449c719-5ed5-4fd2-bf0b-937add518351 req-847546c3-dde9-4147-a115-3ccb4e3192c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4d0b64-50c4-488e-88d7-29ab24ad4da8", "tag": "7ed510b9-f10d-44b7-8c8c-10f5daa229e6"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:51:46.580744 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-04e5065f-6e04-456d-8556-8acb1ba68278 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.382965 May 12 09:51:46.596139 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 616/1228] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:46 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:46.596270 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-f449c719-5ed5-4fd2-bf0b-937add518351 req-847546c3-dde9-4147-a115-3ccb4e3192c2 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:46.596270 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-f449c719-5ed5-4fd2-bf0b-937add518351 req-847546c3-dde9-4147-a115-3ccb4e3192c2 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:46.617752 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-f449c719-5ed5-4fd2-bf0b-937add518351 req-847546c3-dde9-4147-a115-3ccb4e3192c2 service nova] Creating event network-changed:7ed510b9-f10d-44b7-8c8c-10f5daa229e6 for instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 on hv-cinder-83769 May 12 09:51:46.626142 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-f449c719-5ed5-4fd2-bf0b-937add518351 req-847546c3-dde9-4147-a115-3ccb4e3192c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104892 May 12 09:51:46.626923 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 613/1229] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:51:47.603737 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5fb601ec-c0d5-4db3-9481-2715800e3648 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:47.604875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5fb601ec-c0d5-4db3-9481-2715800e3648 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:47.611868 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5fb601ec-c0d5-4db3-9481-2715800e3648 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:47.612511 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5fb601ec-c0d5-4db3-9481-2715800e3648 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:47.613438 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5fb601ec-c0d5-4db3-9481-2715800e3648 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:47.614106 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5fb601ec-c0d5-4db3-9481-2715800e3648 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:47.788967 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5fb601ec-c0d5-4db3-9481-2715800e3648 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:47.796445 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5fb601ec-c0d5-4db3-9481-2715800e3648 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.196686 May 12 09:51:47.797013 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 617/1230] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:47 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:48.813488 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5084bf92-180d-4e6c-aa1e-d68eee155a93 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:48.814165 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5084bf92-180d-4e6c-aa1e-d68eee155a93 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:48.820948 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5084bf92-180d-4e6c-aa1e-d68eee155a93 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:48.821402 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5084bf92-180d-4e6c-aa1e-d68eee155a93 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:48.822198 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5084bf92-180d-4e6c-aa1e-d68eee155a93 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:48.822642 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5084bf92-180d-4e6c-aa1e-d68eee155a93 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:48.843929 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-6ac39deb-7061-43f5-b930-837e09aa4600 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] Action: 'create', calling method: .version_select at 0x7f872627e790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-865147662", "metadata": {"Type": "work"}}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:51:48.952588 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5084bf92-180d-4e6c-aa1e-d68eee155a93 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:48.959977 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5084bf92-180d-4e6c-aa1e-d68eee155a93 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.150278 May 12 09:51:48.960731 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 618/1231] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:48 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:51:49.121873 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-6ac39deb-7061-43f5-b930-837e09aa4600 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.387545 May 12 09:51:49.122629 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 614/1232] 10.222.0.60 () {60 vars in 1155 bytes} [Thu May 12 09:51:48 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 389 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 12 09:51:49.134790 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-46d105ef-1e46-48ae-955a-07c9ff5feb5f tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] Calling method '.version_select at 0x7f8727538550>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:49.183913 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-46d105ef-1e46-48ae-955a-07c9ff5feb5f tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266" status: 200 len: 352 microversion: 2.1 time: 0.053653 May 12 09:51:49.184484 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 619/1233] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:51:49 2022] GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:51:49.977819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-4e4895ad-433f-45ab-b236-dead15c2067a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:49.978627 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-4e4895ad-433f-45ab-b236-dead15c2067a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:49.985238 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e4895ad-433f-45ab-b236-dead15c2067a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:49.985684 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e4895ad-433f-45ab-b236-dead15c2067a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:49.986477 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e4895ad-433f-45ab-b236-dead15c2067a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:49.986909 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-4e4895ad-433f-45ab-b236-dead15c2067a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:50.112377 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-4e4895ad-433f-45ab-b236-dead15c2067a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:50.119679 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-4e4895ad-433f-45ab-b236-dead15c2067a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.146807 May 12 09:51:50.120229 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 615/1234] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:49 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:50.197124 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e73a2900-3497-4b36-9e85-1f8b68436f0c tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] Calling method '.version_select at 0x7f8727e72f70>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:50.251527 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e73a2900-3497-4b36-9e85-1f8b68436f0c tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266" status: 200 len: 353 microversion: 2.1 time: 0.058990 May 12 09:51:50.252079 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 620/1235] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:51:50 2022] GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:51:50.263235 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-751bee4e-bc61-40ef-9ecc-96d9d92870a5 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] Calling method '.version_select at 0x7f872627eb80>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:50.310180 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-751bee4e-bc61-40ef-9ecc-96d9d92870a5 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266" status: 200 len: 353 microversion: 2.1 time: 0.050581 May 12 09:51:50.310739 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 616/1236] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:51:50 2022] GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:51:50.327031 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-9cf8f264-cccf-443f-aaff-4d8c9500a259 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] Calling method '.version_select at 0x7f872644be50>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:50.390789 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-9cf8f264-cccf-443f-aaff-4d8c9500a259 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266" status: 202 len: 0 microversion: 2.1 time: 0.067126 May 12 09:51:50.394674 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 621/1237] 10.222.0.60 () {58 vars in 1247 bytes} [Thu May 12 09:51:50 2022] DELETE /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:51:50.401147 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-3e921fd4-27d7-4c93-b4e5-a1b2af312617 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] Calling method '.version_select at 0x7f872624b790>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:50.449029 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-3e921fd4-27d7-4c93-b4e5-a1b2af312617 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266" status: 200 len: 352 microversion: 2.1 time: 0.052913 May 12 09:51:50.449643 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 617/1238] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:51:50 2022] GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:51:51.135517 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-36c34365-575d-4147-b370-3f1a477a3b85 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:51.136127 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-36c34365-575d-4147-b370-3f1a477a3b85 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:51.142544 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36c34365-575d-4147-b370-3f1a477a3b85 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:51.142993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36c34365-575d-4147-b370-3f1a477a3b85 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:51.143758 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36c34365-575d-4147-b370-3f1a477a3b85 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:51.144196 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-36c34365-575d-4147-b370-3f1a477a3b85 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:51.272234 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-36c34365-575d-4147-b370-3f1a477a3b85 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:51.279994 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-36c34365-575d-4147-b370-3f1a477a3b85 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.148403 May 12 09:51:51.280564 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 622/1239] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:51 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:51.462460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-cc4af42f-8c13-407f-89ef-e3d1fc013307 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] Calling method '.version_select at 0x7f872626f820>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:51.489322 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-cc4af42f-8c13-407f-89ef-e3d1fc013307 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] HTTP exception thrown: Volume 3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 could not be found. May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-cc4af42f-8c13-407f-89ef-e3d1fc013307 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] Request method failure captured: May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 HTTP/1.1 May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNi0os_N1tXH6boAzmhy62ZAG5-1MDGBqy-AHx-TfXFurC7MD81MOzE7KDsVFVLwjnVz_HjEzc8Ij29mborHxHXoy25Yi57Hy1ZtIH23t-JxNUeDPqjmavpVvJXk8HOpuSCPHhTseqZ9EHlH58-bLk_vG1evZXzID1rn1yvnlVWCdJE May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: 4c313f817ab146bfba3db68f3931a848 May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-VolumesGetTestJSON-1421779312 May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:51:51.491397 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_4c313f817ab146bfba3db68f3931a848", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c313f817ab146bfba3db68f3931a848"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/4c313f817ab146bfba3db68f3931a848"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/4c313f817ab146bfba3db68f3931a848"}]}] May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-VolumesGetTestJSON-1421779312 May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: 4c313f817ab146bfba3db68f3931a848 May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-VolumesGetTestJSON-1421779312 May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-VolumesGetTestJSON-1421779312-project May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 866a1947b37943adb2a2705ad3245fe3 May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-VolumesGetTestJSON-1421779312-project May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Volume 3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 could not be found. May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266'} May 12 09:51:51.493104 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 could not be found. (HTTP 404) (Request-ID: req-9de54603-2f3a-4830-bf73-c9a1c5322de5) May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:51.494192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi item = cinderclient( May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 12 09:51:51.495867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 could not be found. May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 12 09:51:51.497411 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 could not be found. May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 could not be found. May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-cc4af42f-8c13-407f-89ef-e3d1fc013307 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] Returning 404 to user: Volume 3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-cc4af42f-8c13-407f-89ef-e3d1fc013307 tempest-VolumesGetTestJSON-1421779312 tempest-VolumesGetTestJSON-1421779312-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266" status: 404 len: 109 microversion: 2.1 time: 0.035199 May 12 09:51:51.498931 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 618/1240] 10.222.0.60 () {58 vars in 1244 bytes} [Thu May 12 09:51:51 2022] GET /compute/v2.1/os-volumes/3ba7aa05-8ea1-4cbb-a1d8-1dd5624f4266 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:51:52.296591 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-54283811-bedd-4b08-a252-2a84edc3f4c3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:52.297224 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-54283811-bedd-4b08-a252-2a84edc3f4c3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:52.303616 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-54283811-bedd-4b08-a252-2a84edc3f4c3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:52.304062 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-54283811-bedd-4b08-a252-2a84edc3f4c3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:52.304816 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-54283811-bedd-4b08-a252-2a84edc3f4c3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:52.305940 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-54283811-bedd-4b08-a252-2a84edc3f4c3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:52.438987 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-54283811-bedd-4b08-a252-2a84edc3f4c3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:52.446224 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-54283811-bedd-4b08-a252-2a84edc3f4c3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.153464 May 12 09:51:52.446785 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 623/1241] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:52 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:51:53.463002 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-e37db80c-a0f9-407c-bee6-ee96219d5c4a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:53.463609 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-e37db80c-a0f9-407c-bee6-ee96219d5c4a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:53.469860 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e37db80c-a0f9-407c-bee6-ee96219d5c4a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:53.470338 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e37db80c-a0f9-407c-bee6-ee96219d5c4a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:53.471098 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e37db80c-a0f9-407c-bee6-ee96219d5c4a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:53.471530 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-e37db80c-a0f9-407c-bee6-ee96219d5c4a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:53.606070 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-e37db80c-a0f9-407c-bee6-ee96219d5c4a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:53.613377 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-e37db80c-a0f9-407c-bee6-ee96219d5c4a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.154650 May 12 09:51:53.613972 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 619/1242] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:53 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:54.630783 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-d955d331-579c-44f0-9c58-9b913358c708 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:54.631393 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-d955d331-579c-44f0-9c58-9b913358c708 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:54.637861 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d955d331-579c-44f0-9c58-9b913358c708 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:54.638471 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d955d331-579c-44f0-9c58-9b913358c708 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:54.639242 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d955d331-579c-44f0-9c58-9b913358c708 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:54.639679 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-d955d331-579c-44f0-9c58-9b913358c708 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:54.768711 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-d955d331-579c-44f0-9c58-9b913358c708 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:54.776336 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-d955d331-579c-44f0-9c58-9b913358c708 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.149572 May 12 09:51:54.776913 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 624/1243] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:54 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:55.797634 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-c2f9e7ae-94d2-4b8d-a98e-4f4a913ebeed tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:55.798274 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-c2f9e7ae-94d2-4b8d-a98e-4f4a913ebeed tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:55.804626 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2f9e7ae-94d2-4b8d-a98e-4f4a913ebeed tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:55.805638 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2f9e7ae-94d2-4b8d-a98e-4f4a913ebeed tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:55.806441 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2f9e7ae-94d2-4b8d-a98e-4f4a913ebeed tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:55.806871 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-c2f9e7ae-94d2-4b8d-a98e-4f4a913ebeed tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:55.952524 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-c2f9e7ae-94d2-4b8d-a98e-4f4a913ebeed tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:55.960005 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-c2f9e7ae-94d2-4b8d-a98e-4f4a913ebeed tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.171477 May 12 09:51:55.960752 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 620/1244] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:55 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:56.979353 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-441a74da-af63-4d53-932a-e3b8fc269183 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:56.980584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-441a74da-af63-4d53-932a-e3b8fc269183 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:56.987213 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-441a74da-af63-4d53-932a-e3b8fc269183 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:56.987907 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-441a74da-af63-4d53-932a-e3b8fc269183 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:56.988676 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-441a74da-af63-4d53-932a-e3b8fc269183 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:56.989106 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-441a74da-af63-4d53-932a-e3b8fc269183 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:57.181105 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-441a74da-af63-4d53-932a-e3b8fc269183 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:57.190204 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-441a74da-af63-4d53-932a-e3b8fc269183 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.214753 May 12 09:51:57.190779 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 625/1245] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:56 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:58.207099 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f414408e-8c15-4560-b72a-62689874a260 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:58.207801 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f414408e-8c15-4560-b72a-62689874a260 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:58.214501 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f414408e-8c15-4560-b72a-62689874a260 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:58.215034 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f414408e-8c15-4560-b72a-62689874a260 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:58.215916 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f414408e-8c15-4560-b72a-62689874a260 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:58.216428 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f414408e-8c15-4560-b72a-62689874a260 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:58.365597 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f414408e-8c15-4560-b72a-62689874a260 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:58.372949 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f414408e-8c15-4560-b72a-62689874a260 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.169739 May 12 09:51:58.373520 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 621/1246] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:58 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:51:58.822755 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-3beff13e-696c-424a-81f0-ecc03a09b560 req-bc3a72bb-4b16-45c3-9178-4fa5cdca4dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4d0b64-50c4-488e-88d7-29ab24ad4da8", "name": "network-vif-plugged", "status": "completed", "tag": "7ed510b9-f10d-44b7-8c8c-10f5daa229e6"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:51:58.830874 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-3beff13e-696c-424a-81f0-ecc03a09b560 req-bc3a72bb-4b16-45c3-9178-4fa5cdca4dd0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:58.831319 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-3beff13e-696c-424a-81f0-ecc03a09b560 req-bc3a72bb-4b16-45c3-9178-4fa5cdca4dd0 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:58.844070 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-3beff13e-696c-424a-81f0-ecc03a09b560 req-bc3a72bb-4b16-45c3-9178-4fa5cdca4dd0 service nova] Creating event network-vif-plugged:7ed510b9-f10d-44b7-8c8c-10f5daa229e6 for instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 on hv-cinder-83769 May 12 09:51:58.850644 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-3beff13e-696c-424a-81f0-ecc03a09b560 req-bc3a72bb-4b16-45c3-9178-4fa5cdca4dd0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213562 May 12 09:51:58.851314 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 626/1247] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:51:59.389033 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5cc9fc53-92e2-4490-b4ae-6db2d535fa2c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:51:59.389746 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5cc9fc53-92e2-4490-b4ae-6db2d535fa2c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:51:59.396218 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5cc9fc53-92e2-4490-b4ae-6db2d535fa2c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:59.396669 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5cc9fc53-92e2-4490-b4ae-6db2d535fa2c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:59.397429 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5cc9fc53-92e2-4490-b4ae-6db2d535fa2c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:51:59.397864 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5cc9fc53-92e2-4490-b4ae-6db2d535fa2c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:51:59.525062 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-5cc9fc53-92e2-4490-b4ae-6db2d535fa2c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:51:59.533207 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5cc9fc53-92e2-4490-b4ae-6db2d535fa2c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1263 microversion: 2.1 time: 0.147561 May 12 09:51:59.534155 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 622/1248] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:51:59 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:52:00.551247 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2e7dd608-b125-4a77-999e-056856f2ce03 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:52:00.551946 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2e7dd608-b125-4a77-999e-056856f2ce03 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:52:00.558427 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e7dd608-b125-4a77-999e-056856f2ce03 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:52:00.558877 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e7dd608-b125-4a77-999e-056856f2ce03 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:52:00.559652 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e7dd608-b125-4a77-999e-056856f2ce03 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:52:00.560087 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2e7dd608-b125-4a77-999e-056856f2ce03 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:52:00.691161 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2e7dd608-b125-4a77-999e-056856f2ce03 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:52:00.699153 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2e7dd608-b125-4a77-999e-056856f2ce03 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1450 microversion: 2.1 time: 0.152600 May 12 09:52:00.699722 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 627/1249] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:52:00 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:52:00.714879 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2ae4ef47-819f-4a10-96d8-3ba84568db55 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:52:00.715491 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2ae4ef47-819f-4a10-96d8-3ba84568db55 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:52:00.721806 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ae4ef47-819f-4a10-96d8-3ba84568db55 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:52:00.722300 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ae4ef47-819f-4a10-96d8-3ba84568db55 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:52:00.723071 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ae4ef47-819f-4a10-96d8-3ba84568db55 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:52:00.723515 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2ae4ef47-819f-4a10-96d8-3ba84568db55 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:52:00.856651 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2ae4ef47-819f-4a10-96d8-3ba84568db55 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:52:00.864314 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2ae4ef47-819f-4a10-96d8-3ba84568db55 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1450 microversion: 2.1 time: 0.153222 May 12 09:52:00.864899 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 623/1250] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:52:00 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:52:02.624291 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-ff613972-b6c4-453e-8d36-1a0336c5190b req-d8a3fd3f-f224-422c-a6f4-c9343b127fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4d0b64-50c4-488e-88d7-29ab24ad4da8", "tag": "7ed510b9-f10d-44b7-8c8c-10f5daa229e6"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:52:02.632354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-ff613972-b6c4-453e-8d36-1a0336c5190b req-d8a3fd3f-f224-422c-a6f4-c9343b127fc3 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:52:02.632921 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-ff613972-b6c4-453e-8d36-1a0336c5190b req-d8a3fd3f-f224-422c-a6f4-c9343b127fc3 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:52:02.643990 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-ff613972-b6c4-453e-8d36-1a0336c5190b req-d8a3fd3f-f224-422c-a6f4-c9343b127fc3 service nova] Creating event network-changed:7ed510b9-f10d-44b7-8c8c-10f5daa229e6 for instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 on hv-cinder-83769 May 12 09:52:02.649157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-ff613972-b6c4-453e-8d36-1a0336c5190b req-d8a3fd3f-f224-422c-a6f4-c9343b127fc3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145563 May 12 09:52:02.649844 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 628/1251] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:53:50.546867 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:53:50.547575 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Thu May 12 09:53:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:53:51.944440 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:53:51.945042 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Thu May 12 09:53:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:54:03.437003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1026554625", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-744304972", "security_groups": [{"name": "tempest-secgroup-smoke-176244007"}], "block_device_mapping_v2": [{"uuid": "0fc403f8-0836-4b24-b3bd-816a074f4daa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f6f9b602-5994-4479-ba8e-6005a9bbaa39"}]}} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:54:03.543073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.network.neutron [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] validate_networks() for [('f6f9b602-5994-4479-ba8e-6005a9bbaa39', None, None, None, None, None)] {{(pid=123509) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 12 09:54:03.896605 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Flavor limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 09:54:03.897080 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Image limits 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 09:54:03.897494 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Flavor pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 09:54:03.897932 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Image pref 0:0:0 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 09:54:03.898448 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.virt.hardware [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 09:54:03.906865 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:03.907308 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:03.908093 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:03.908518 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:03.924041 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Getting quotas for project 6e6bc2241970493783de557e3f690105. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 12 09:54:03.927753 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.quota [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Getting quotas for user 06be00f6a9ad465195c7606883b4160d and project 6e6bc2241970493783de557e3f690105. Resources: {'cores', 'instances', 'ram'} {{(pid=123509) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 12 09:54:03.981855 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Going to run 1 instances... {{(pid=123509) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 12 09:54:03.984053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fc403f8-0836-4b24-b3bd-816a074f4daa',volume_size=None,volume_type=None)] {{(pid=123509) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 12 09:54:04.106161 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9ef92885-0c6c-425a-995f-cf5fe5129cf2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.673979 May 12 09:54:04.106811 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 624/1252] 10.222.0.60 () {60 vars in 1146 bytes} [Thu May 12 09:54:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 09:54:04.117746 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5f5bd4a0-b668-4826-9f3d-e27c6f5b2a7c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:04.118980 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5f5bd4a0-b668-4826-9f3d-e27c6f5b2a7c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:04.122392 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c40322cd-f742-4c81-8c75-4e857ace1ab5] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 12 09:54:04.330581 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5f5bd4a0-b668-4826-9f3d-e27c6f5b2a7c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:04.337309 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5f5bd4a0-b668-4826-9f3d-e27c6f5b2a7c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1094 microversion: 2.1 time: 0.224359 May 12 09:54:04.337875 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 629/1253] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:04 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1094 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:05.338247 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:54:05.338968 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Thu May 12 09:54:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:54:05.354081 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-64b12768-29b2-4175-bbc2-c82660637db9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:05.354630 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-64b12768-29b2-4175-bbc2-c82660637db9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:05.361414 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-64b12768-29b2-4175-bbc2-c82660637db9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:05.361865 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-64b12768-29b2-4175-bbc2-c82660637db9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:05.362664 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-64b12768-29b2-4175-bbc2-c82660637db9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:05.363107 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-64b12768-29b2-4175-bbc2-c82660637db9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:05.447445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-64b12768-29b2-4175-bbc2-c82660637db9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:05.454734 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-64b12768-29b2-4175-bbc2-c82660637db9 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1210 microversion: 2.1 time: 0.105249 May 12 09:54:05.455526 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 625/1254] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:05 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1210 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:06.471645 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-3c34a340-d8f4-4d25-a0f9-77a642306187 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:06.472371 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-3c34a340-d8f4-4d25-a0f9-77a642306187 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:06.483196 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3c34a340-d8f4-4d25-a0f9-77a642306187 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:06.483646 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3c34a340-d8f4-4d25-a0f9-77a642306187 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:06.484422 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3c34a340-d8f4-4d25-a0f9-77a642306187 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:06.484864 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-3c34a340-d8f4-4d25-a0f9-77a642306187 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:06.500319 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] [c40322cd-f742-4c81-8c75-4e857ace1ab5] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 39444. May 12 09:54:06.708654 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-3c34a340-d8f4-4d25-a0f9-77a642306187 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:06.716695 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-3c34a340-d8f4-4d25-a0f9-77a642306187 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.248850 May 12 09:54:06.717270 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 630/1255] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:06 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:06.861460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-5092d33c-2b15-4fac-aeea-166c1c5c75d1 req-7102babe-e7f5-49a7-acf7-d2772caa2685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1226a4b5-6030-480a-8f17-4f32745a6f99", "tag": "82ee8c9d-96c7-4b79-a8b3-851e1aaed771"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:54:06.873583 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-5092d33c-2b15-4fac-aeea-166c1c5c75d1 req-7102babe-e7f5-49a7-acf7-d2772caa2685 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:06.874049 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-5092d33c-2b15-4fac-aeea-166c1c5c75d1 req-7102babe-e7f5-49a7-acf7-d2772caa2685 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:06.890216 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-5092d33c-2b15-4fac-aeea-166c1c5c75d1 req-7102babe-e7f5-49a7-acf7-d2772caa2685 service nova] Creating event network-changed:82ee8c9d-96c7-4b79-a8b3-851e1aaed771 for instance 1226a4b5-6030-480a-8f17-4f32745a6f99 on hv-cinder-83769 May 12 09:54:06.906541 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-5092d33c-2b15-4fac-aeea-166c1c5c75d1 req-7102babe-e7f5-49a7-acf7-d2772caa2685 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048666 May 12 09:54:06.907268 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 626/1256] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:54:07.734460 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-64f419bc-d672-48f0-9732-eecee94075d2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:07.735080 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-64f419bc-d672-48f0-9732-eecee94075d2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:07.741382 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-64f419bc-d672-48f0-9732-eecee94075d2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:07.741838 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-64f419bc-d672-48f0-9732-eecee94075d2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:07.742638 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-64f419bc-d672-48f0-9732-eecee94075d2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:07.743084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-64f419bc-d672-48f0-9732-eecee94075d2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:07.876999 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-64f419bc-d672-48f0-9732-eecee94075d2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:07.884545 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-64f419bc-d672-48f0-9732-eecee94075d2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.154021 May 12 09:54:07.885112 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 631/1257] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:07 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:08.901204 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-68c073ab-fac2-45e3-b5fa-edbc158a6245 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:08.901922 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-68c073ab-fac2-45e3-b5fa-edbc158a6245 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:08.908334 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68c073ab-fac2-45e3-b5fa-edbc158a6245 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:08.908788 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68c073ab-fac2-45e3-b5fa-edbc158a6245 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:08.909550 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68c073ab-fac2-45e3-b5fa-edbc158a6245 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:08.910083 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68c073ab-fac2-45e3-b5fa-edbc158a6245 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:09.042766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-68c073ab-fac2-45e3-b5fa-edbc158a6245 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:09.050042 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-68c073ab-fac2-45e3-b5fa-edbc158a6245 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.153042 May 12 09:54:09.050616 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 627/1258] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:08 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:10.067256 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-46747802-f7c8-47c3-93ae-5ce257ff788a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:10.067858 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-46747802-f7c8-47c3-93ae-5ce257ff788a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:10.074748 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-46747802-f7c8-47c3-93ae-5ce257ff788a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:10.075195 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-46747802-f7c8-47c3-93ae-5ce257ff788a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:10.075949 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-46747802-f7c8-47c3-93ae-5ce257ff788a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:10.076381 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-46747802-f7c8-47c3-93ae-5ce257ff788a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:10.207473 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-46747802-f7c8-47c3-93ae-5ce257ff788a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:10.214979 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-46747802-f7c8-47c3-93ae-5ce257ff788a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.151636 May 12 09:54:10.215542 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 632/1259] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:10 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:11.231644 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-816457af-8d1c-44f7-9538-2166e447e154 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:11.232285 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-816457af-8d1c-44f7-9538-2166e447e154 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:11.238618 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-816457af-8d1c-44f7-9538-2166e447e154 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:11.239067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-816457af-8d1c-44f7-9538-2166e447e154 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:11.239827 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-816457af-8d1c-44f7-9538-2166e447e154 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:11.240265 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-816457af-8d1c-44f7-9538-2166e447e154 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:11.420956 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-816457af-8d1c-44f7-9538-2166e447e154 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:11.428368 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-816457af-8d1c-44f7-9538-2166e447e154 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.200613 May 12 09:54:11.428937 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 628/1260] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:11 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:12.445643 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5e0ea311-31fe-418a-9285-284f30876fa2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:12.446228 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5e0ea311-31fe-418a-9285-284f30876fa2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:12.453052 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5e0ea311-31fe-418a-9285-284f30876fa2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:12.453497 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5e0ea311-31fe-418a-9285-284f30876fa2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:12.454279 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5e0ea311-31fe-418a-9285-284f30876fa2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:12.454715 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5e0ea311-31fe-418a-9285-284f30876fa2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:12.580585 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-5e0ea311-31fe-418a-9285-284f30876fa2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:12.588322 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5e0ea311-31fe-418a-9285-284f30876fa2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.146641 May 12 09:54:12.588883 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 633/1261] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:12 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:13.604042 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-f2230455-91ba-4950-b594-2ddc2eb24ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:13.604709 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-f2230455-91ba-4950-b594-2ddc2eb24ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:13.611005 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f2230455-91ba-4950-b594-2ddc2eb24ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:13.611455 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f2230455-91ba-4950-b594-2ddc2eb24ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:13.612214 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f2230455-91ba-4950-b594-2ddc2eb24ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:13.612657 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-f2230455-91ba-4950-b594-2ddc2eb24ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:13.754575 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-f2230455-91ba-4950-b594-2ddc2eb24ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:13.761824 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-f2230455-91ba-4950-b594-2ddc2eb24ddb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.161630 May 12 09:54:13.762416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 629/1262] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:13 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:14.778936 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-091c8246-34a5-469d-a8e6-7ec79f0283bc tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:14.779559 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-091c8246-34a5-469d-a8e6-7ec79f0283bc tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:14.785965 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-091c8246-34a5-469d-a8e6-7ec79f0283bc tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:14.786475 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-091c8246-34a5-469d-a8e6-7ec79f0283bc tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:14.787277 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-091c8246-34a5-469d-a8e6-7ec79f0283bc tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:14.787716 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-091c8246-34a5-469d-a8e6-7ec79f0283bc tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:14.915325 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-091c8246-34a5-469d-a8e6-7ec79f0283bc tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:14.922522 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-091c8246-34a5-469d-a8e6-7ec79f0283bc tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.148184 May 12 09:54:14.923078 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 634/1263] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:14 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:15.938973 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-9dd6f192-6717-45d6-a09a-ebf20f5a2fee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:15.939584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-9dd6f192-6717-45d6-a09a-ebf20f5a2fee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:15.945547 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9dd6f192-6717-45d6-a09a-ebf20f5a2fee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:15.946037 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9dd6f192-6717-45d6-a09a-ebf20f5a2fee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:15.946798 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9dd6f192-6717-45d6-a09a-ebf20f5a2fee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:15.947233 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-9dd6f192-6717-45d6-a09a-ebf20f5a2fee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:16.071259 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-9dd6f192-6717-45d6-a09a-ebf20f5a2fee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:16.078977 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-9dd6f192-6717-45d6-a09a-ebf20f5a2fee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.143838 May 12 09:54:16.079570 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 630/1264] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:15 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:17.095723 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-0ad45267-6afe-429a-8b5a-0e9ab29341ee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:17.096989 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-0ad45267-6afe-429a-8b5a-0e9ab29341ee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:17.103807 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0ad45267-6afe-429a-8b5a-0e9ab29341ee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:17.104344 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0ad45267-6afe-429a-8b5a-0e9ab29341ee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:17.105112 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0ad45267-6afe-429a-8b5a-0e9ab29341ee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:17.105542 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-0ad45267-6afe-429a-8b5a-0e9ab29341ee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:17.238703 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-0ad45267-6afe-429a-8b5a-0e9ab29341ee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:17.246067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-0ad45267-6afe-429a-8b5a-0e9ab29341ee tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.154167 May 12 09:54:17.246642 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 635/1265] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:17 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:18.263229 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-a71c1985-3166-49f1-83f6-a02d1baefb8a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:18.263867 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-a71c1985-3166-49f1-83f6-a02d1baefb8a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:18.270434 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a71c1985-3166-49f1-83f6-a02d1baefb8a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:18.270880 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a71c1985-3166-49f1-83f6-a02d1baefb8a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:18.271639 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a71c1985-3166-49f1-83f6-a02d1baefb8a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:18.272073 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-a71c1985-3166-49f1-83f6-a02d1baefb8a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:18.396999 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-a71c1985-3166-49f1-83f6-a02d1baefb8a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:18.404192 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-a71c1985-3166-49f1-83f6-a02d1baefb8a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.145480 May 12 09:54:18.404755 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 631/1266] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:18 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:19.208683 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [req-f98d9dfe-ba12-4a1a-859b-f016ff41186f req-a89f0195-30bf-41d2-8a33-7725cef41291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1226a4b5-6030-480a-8f17-4f32745a6f99", "name": "network-vif-plugged", "status": "completed", "tag": "82ee8c9d-96c7-4b79-a8b3-851e1aaed771"}]} {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:54:19.217615 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f98d9dfe-ba12-4a1a-859b-f016ff41186f req-a89f0195-30bf-41d2-8a33-7725cef41291 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:19.218079 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [req-f98d9dfe-ba12-4a1a-859b-f016ff41186f req-a89f0195-30bf-41d2-8a33-7725cef41291 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:19.231809 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.compute.server_external_events [req-f98d9dfe-ba12-4a1a-859b-f016ff41186f req-a89f0195-30bf-41d2-8a33-7725cef41291 service nova] Creating event network-vif-plugged:82ee8c9d-96c7-4b79-a8b3-851e1aaed771 for instance 1226a4b5-6030-480a-8f17-4f32745a6f99 on hv-cinder-83769 May 12 09:54:19.237676 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [req-f98d9dfe-ba12-4a1a-859b-f016ff41186f req-a89f0195-30bf-41d2-8a33-7725cef41291 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032633 May 12 09:54:19.238300 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 636/1267] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:54:19.420592 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-83c6c31e-38cc-4653-8a7e-986d907ce979 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:19.421218 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-83c6c31e-38cc-4653-8a7e-986d907ce979 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:19.427400 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-83c6c31e-38cc-4653-8a7e-986d907ce979 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:19.427853 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-83c6c31e-38cc-4653-8a7e-986d907ce979 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:19.428623 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-83c6c31e-38cc-4653-8a7e-986d907ce979 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:19.429059 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-83c6c31e-38cc-4653-8a7e-986d907ce979 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:19.610112 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-83c6c31e-38cc-4653-8a7e-986d907ce979 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:19.617304 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-83c6c31e-38cc-4653-8a7e-986d907ce979 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.200651 May 12 09:54:19.617915 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 632/1268] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:19 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:20.635334 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2bdc1a13-3e0f-464d-b267-72efec1de2d1 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:20.636020 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2bdc1a13-3e0f-464d-b267-72efec1de2d1 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:20.642218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2bdc1a13-3e0f-464d-b267-72efec1de2d1 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:20.642922 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2bdc1a13-3e0f-464d-b267-72efec1de2d1 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:20.643674 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2bdc1a13-3e0f-464d-b267-72efec1de2d1 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:20.644103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2bdc1a13-3e0f-464d-b267-72efec1de2d1 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:20.773349 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2bdc1a13-3e0f-464d-b267-72efec1de2d1 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:20.781133 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2bdc1a13-3e0f-464d-b267-72efec1de2d1 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1265 microversion: 2.1 time: 0.150415 May 12 09:54:20.781685 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 637/1269] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:20 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:21.797979 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-00e6f721-5c27-4d83-901f-8c71ab4594a2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:21.798584 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-00e6f721-5c27-4d83-901f-8c71ab4594a2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:21.804780 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00e6f721-5c27-4d83-901f-8c71ab4594a2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:21.805224 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00e6f721-5c27-4d83-901f-8c71ab4594a2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:21.806012 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00e6f721-5c27-4d83-901f-8c71ab4594a2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:21.806445 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-00e6f721-5c27-4d83-901f-8c71ab4594a2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:21.936984 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-00e6f721-5c27-4d83-901f-8c71ab4594a2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:21.944313 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-00e6f721-5c27-4d83-901f-8c71ab4594a2 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1453 microversion: 2.1 time: 0.150180 May 12 09:54:21.944877 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 633/1270] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:21 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:21.959872 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-f66f5ac6-9e4d-4678-94a6-7021fa5d3176 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:54:21.960476 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-f66f5ac6-9e4d-4678-94a6-7021fa5d3176 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:54:21.967345 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f66f5ac6-9e4d-4678-94a6-7021fa5d3176 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:21.967797 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f66f5ac6-9e4d-4678-94a6-7021fa5d3176 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:21.968557 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f66f5ac6-9e4d-4678-94a6-7021fa5d3176 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:21.968993 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-f66f5ac6-9e4d-4678-94a6-7021fa5d3176 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:22.093767 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-f66f5ac6-9e4d-4678-94a6-7021fa5d3176 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:54:22.101289 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-f66f5ac6-9e4d-4678-94a6-7021fa5d3176 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1453 microversion: 2.1 time: 0.145211 May 12 09:54:22.101862 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 638/1271] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:54:21 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:54:24.037744 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-608a4b4e-2734-4af3-9495-1ec5a358af55 req-e71a8ef0-db28-4d0a-89ef-eda9ec6dc629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1226a4b5-6030-480a-8f17-4f32745a6f99", "tag": "82ee8c9d-96c7-4b79-a8b3-851e1aaed771"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:54:24.046837 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-608a4b4e-2734-4af3-9495-1ec5a358af55 req-e71a8ef0-db28-4d0a-89ef-eda9ec6dc629 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:54:24.047379 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-608a4b4e-2734-4af3-9495-1ec5a358af55 req-e71a8ef0-db28-4d0a-89ef-eda9ec6dc629 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:54:24.058190 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-608a4b4e-2734-4af3-9495-1ec5a358af55 req-e71a8ef0-db28-4d0a-89ef-eda9ec6dc629 service nova] Creating event network-changed:82ee8c9d-96c7-4b79-a8b3-851e1aaed771 for instance 1226a4b5-6030-480a-8f17-4f32745a6f99 on hv-cinder-83769 May 12 09:54:24.063247 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-608a4b4e-2734-4af3-9495-1ec5a358af55 req-e71a8ef0-db28-4d0a-89ef-eda9ec6dc629 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029171 May 12 09:54:24.063912 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 634/1272] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 09:55:43.030194 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:55:43.030829 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Thu May 12 09:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:56:13.564416 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-5a21fa13-02bf-4fd6-8493-3d0325bced46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:13.565083 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5a21fa13-02bf-4fd6-8493-3d0325bced46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:13.567259 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-ea381043-4db3-4516-939d-525de7af6117 req-629f7d1d-a7c5-40ac-bd67-838acf6fcbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1226a4b5-6030-480a-8f17-4f32745a6f99", "tag": "82ee8c9d-96c7-4b79-a8b3-851e1aaed771"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:56:13.572114 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5a21fa13-02bf-4fd6-8493-3d0325bced46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:13.573156 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5a21fa13-02bf-4fd6-8493-3d0325bced46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:13.574254 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5a21fa13-02bf-4fd6-8493-3d0325bced46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:13.574701 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-5a21fa13-02bf-4fd6-8493-3d0325bced46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:13.575371 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-ea381043-4db3-4516-939d-525de7af6117 req-629f7d1d-a7c5-40ac-bd67-838acf6fcbee service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:13.575819 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-ea381043-4db3-4516-939d-525de7af6117 req-629f7d1d-a7c5-40ac-bd67-838acf6fcbee service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:13.587218 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-ea381043-4db3-4516-939d-525de7af6117 req-629f7d1d-a7c5-40ac-bd67-838acf6fcbee service nova] Creating event network-changed:82ee8c9d-96c7-4b79-a8b3-851e1aaed771 for instance 1226a4b5-6030-480a-8f17-4f32745a6f99 on hv-cinder-83769 May 12 09:56:13.593326 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-ea381043-4db3-4516-939d-525de7af6117 req-629f7d1d-a7c5-40ac-bd67-838acf6fcbee service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031756 May 12 09:56:13.596953 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 635/1273] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:56:13.600434 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-5a21fa13-02bf-4fd6-8493-3d0325bced46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:56:13.687229 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-5a21fa13-02bf-4fd6-8493-3d0325bced46 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 204 len: 0 microversion: 2.1 time: 0.126987 May 12 09:56:13.688268 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 639/1274] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:56:13 2022] DELETE /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:56:13.702003 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-2b134cf1-b88e-40c2-943e-1c9b2f638824 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:13.702703 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-2b134cf1-b88e-40c2-943e-1c9b2f638824 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:13.708734 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b134cf1-b88e-40c2-943e-1c9b2f638824 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:13.709180 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b134cf1-b88e-40c2-943e-1c9b2f638824 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:13.709967 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b134cf1-b88e-40c2-943e-1c9b2f638824 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:13.710407 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-2b134cf1-b88e-40c2-943e-1c9b2f638824 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:13.844396 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-2b134cf1-b88e-40c2-943e-1c9b2f638824 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:56:13.851907 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-2b134cf1-b88e-40c2-943e-1c9b2f638824 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1578 microversion: 2.1 time: 0.158271 May 12 09:56:13.852467 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 636/1275] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:56:13 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 09:56:14.869303 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-e5f1b258-ca30-478b-b2b6-a878736f9dd0 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:14.870067 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-e5f1b258-ca30-478b-b2b6-a878736f9dd0 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:14.877451 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e5f1b258-ca30-478b-b2b6-a878736f9dd0 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:14.877924 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e5f1b258-ca30-478b-b2b6-a878736f9dd0 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:14.878708 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e5f1b258-ca30-478b-b2b6-a878736f9dd0 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:14.879146 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-e5f1b258-ca30-478b-b2b6-a878736f9dd0 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:15.043391 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-e5f1b258-ca30-478b-b2b6-a878736f9dd0 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:56:15.050733 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-e5f1b258-ca30-478b-b2b6-a878736f9dd0 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1578 microversion: 2.1 time: 0.185745 May 12 09:56:15.051297 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 640/1276] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:56:14 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:56:15.977517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-777e131b-05b5-4bb4-80df-12bb0d1be178 req-ed87d672-7584-49a2-b528-611fc32aecca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1226a4b5-6030-480a-8f17-4f32745a6f99", "name": "network-vif-deleted", "tag": "82ee8c9d-96c7-4b79-a8b3-851e1aaed771"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:56:15.987053 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-777e131b-05b5-4bb4-80df-12bb0d1be178 req-ed87d672-7584-49a2-b528-611fc32aecca service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:15.987498 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-777e131b-05b5-4bb4-80df-12bb0d1be178 req-ed87d672-7584-49a2-b528-611fc32aecca service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:15.998388 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-777e131b-05b5-4bb4-80df-12bb0d1be178 req-ed87d672-7584-49a2-b528-611fc32aecca service nova] Creating event network-vif-deleted:82ee8c9d-96c7-4b79-a8b3-851e1aaed771 for instance 1226a4b5-6030-480a-8f17-4f32745a6f99 on hv-cinder-83769 May 12 09:56:16.003959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-777e131b-05b5-4bb4-80df-12bb0d1be178 req-ed87d672-7584-49a2-b528-611fc32aecca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031384 May 12 09:56:16.004632 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 637/1277] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:56:16.069063 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-54031506-b771-4737-853d-54cab970a5fb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:16.070137 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-54031506-b771-4737-853d-54cab970a5fb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:16.076731 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-54031506-b771-4737-853d-54cab970a5fb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:16.077186 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-54031506-b771-4737-853d-54cab970a5fb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:16.077972 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-54031506-b771-4737-853d-54cab970a5fb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:16.078427 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-54031506-b771-4737-853d-54cab970a5fb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:16.141382 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-54031506-b771-4737-853d-54cab970a5fb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:56:16.148799 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-54031506-b771-4737-853d-54cab970a5fb tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 200 len: 1225 microversion: 2.1 time: 0.083775 May 12 09:56:16.149354 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 641/1278] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:56:16 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:56:17.166512 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:17.167770 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: 1226a4b5-6030-480a-8f17-4f32745a6f99] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:17.173858 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:17.174335 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:17.175099 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:17.175535 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:17.188917 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] HTTP exception thrown: Instance 1226a4b5-6030-480a-8f17-4f32745a6f99 could not be found. May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Request method failure captured: May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 HTTP/1.1 May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNfsSGsklBQKgk2wz8_ns-oseYoeHnatXieF61uEo04yoCIDDZKrFK_4jpXSpv7-HLuPhwt0xwYvCRti6WGSjN25z8DetSurOaNBy0sexdbNJZUaLgjgrV3DHCZ6xyyT3ZOQrkR8uN1tbFWv-U40qZcBt0phwgL5wwmpUUmQcJorimM May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: 6e6bc2241970493783de557e3f690105 May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:56:17.190517 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e6bc2241970493783de557e3f690105", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e6bc2241970493783de557e3f690105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}] May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: 6e6bc2241970493783de557e3f690105 May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-TestVolumeBootPattern-1342689768-project May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 06be00f6a9ad465195c7606883b4160d May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-TestVolumeBootPattern-1342689768-project May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance 1226a4b5-6030-480a-8f17-4f32745a6f99 could not be found. May 12 09:56:17.192343 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': '1226a4b5-6030-480a-8f17-4f32745a6f99'} May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1226a4b5-6030-480a-8f17-4f32745a6f99 could not be found. May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:56:17.193523 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1226a4b5-6030-480a-8f17-4f32745a6f99 could not be found. May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1226a4b5-6030-480a-8f17-4f32745a6f99 could not be found. May 12 09:56:17.195444 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:17.196990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Returning 404 to user: Instance 1226a4b5-6030-480a-8f17-4f32745a6f99 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:56:17.196990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-70f3900d-2027-4e3f-b2eb-a2560434c34d tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99" status: 404 len: 111 microversion: 2.1 time: 0.030151 May 12 09:56:17.196990 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 638/1279] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:56:17 2022] GET /compute/v2.1/servers/1226a4b5-6030-480a-8f17-4f32745a6f99 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:56:20.250768 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-6047185d-c1fd-4b25-8ded-eb64bdaa6d8c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:20.256067 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-30a1f954-2223-4435-a93e-226f299e8b1f req-c8e9935f-0aed-46f2-893b-66f685541fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4d0b64-50c4-488e-88d7-29ab24ad4da8", "tag": "7ed510b9-f10d-44b7-8c8c-10f5daa229e6"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:56:20.260622 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6047185d-c1fd-4b25-8ded-eb64bdaa6d8c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:20.267218 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6047185d-c1fd-4b25-8ded-eb64bdaa6d8c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:20.267410 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-30a1f954-2223-4435-a93e-226f299e8b1f req-c8e9935f-0aed-46f2-893b-66f685541fd5 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:20.267659 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-30a1f954-2223-4435-a93e-226f299e8b1f req-c8e9935f-0aed-46f2-893b-66f685541fd5 service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:20.267803 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6047185d-c1fd-4b25-8ded-eb64bdaa6d8c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:20.268718 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6047185d-c1fd-4b25-8ded-eb64bdaa6d8c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:20.269157 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-6047185d-c1fd-4b25-8ded-eb64bdaa6d8c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:20.280180 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-30a1f954-2223-4435-a93e-226f299e8b1f req-c8e9935f-0aed-46f2-893b-66f685541fd5 service nova] Creating event network-changed:7ed510b9-f10d-44b7-8c8c-10f5daa229e6 for instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 on hv-cinder-83769 May 12 09:56:20.285656 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-30a1f954-2223-4435-a93e-226f299e8b1f req-c8e9935f-0aed-46f2-893b-66f685541fd5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033104 May 12 09:56:20.286767 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 639/1280] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:56:20.299537 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-6047185d-c1fd-4b25-8ded-eb64bdaa6d8c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Going to try to terminate instance {{(pid=123510) delete /opt/stack/nova/nova/compute/api.py:2664}} May 12 09:56:20.377856 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-6047185d-c1fd-4b25-8ded-eb64bdaa6d8c tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 204 len: 0 microversion: 2.1 time: 0.130489 May 12 09:56:20.378584 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 642/1281] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:56:20 2022] DELETE /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 09:56:20.387712 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-68577e8c-d909-474e-abba-80885c77e5e3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:20.388403 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-68577e8c-d909-474e-abba-80885c77e5e3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:20.394848 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68577e8c-d909-474e-abba-80885c77e5e3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:20.395303 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68577e8c-d909-474e-abba-80885c77e5e3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:20.396070 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68577e8c-d909-474e-abba-80885c77e5e3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:20.396505 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-68577e8c-d909-474e-abba-80885c77e5e3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:20.524386 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.policy [None req-68577e8c-d909-474e-abba-80885c77e5e3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123509) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:56:20.532380 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-68577e8c-d909-474e-abba-80885c77e5e3 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1575 microversion: 2.1 time: 0.149151 May 12 09:56:20.532956 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 640/1282] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:56:20 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:56:21.550545 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-67c26cd5-fbe0-4780-886f-0346eae9e3a6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:21.551249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-67c26cd5-fbe0-4780-886f-0346eae9e3a6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:21.557846 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-67c26cd5-fbe0-4780-886f-0346eae9e3a6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:21.558329 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-67c26cd5-fbe0-4780-886f-0346eae9e3a6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:21.559808 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-67c26cd5-fbe0-4780-886f-0346eae9e3a6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:21.560249 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-67c26cd5-fbe0-4780-886f-0346eae9e3a6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:21.698439 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-67c26cd5-fbe0-4780-886f-0346eae9e3a6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:56:21.706285 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-67c26cd5-fbe0-4780-886f-0346eae9e3a6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1575 microversion: 2.1 time: 0.159887 May 12 09:56:21.707166 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 643/1283] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:56:21 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:56:22.576413 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [req-c9b011f7-386e-40ae-b2a6-a342013f9c69 req-f4e4c0e0-e450-45a3-ac21-479067110a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4d0b64-50c4-488e-88d7-29ab24ad4da8", "name": "network-vif-deleted", "tag": "7ed510b9-f10d-44b7-8c8c-10f5daa229e6"}]} {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 09:56:22.587439 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-c9b011f7-386e-40ae-b2a6-a342013f9c69 req-f4e4c0e0-e450-45a3-ac21-479067110a5a service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:22.587886 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [req-c9b011f7-386e-40ae-b2a6-a342013f9c69 req-f4e4c0e0-e450-45a3-ac21-479067110a5a service nova] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:22.600817 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.compute.server_external_events [req-c9b011f7-386e-40ae-b2a6-a342013f9c69 req-f4e4c0e0-e450-45a3-ac21-479067110a5a service nova] Creating event network-vif-deleted:7ed510b9-f10d-44b7-8c8c-10f5daa229e6 for instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 on hv-cinder-83769 May 12 09:56:22.608212 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [req-c9b011f7-386e-40ae-b2a6-a342013f9c69 req-f4e4c0e0-e450-45a3-ac21-479067110a5a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035638 May 12 09:56:22.608803 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 641/1284] 10.222.0.60 () {64 vars in 1317 bytes} [Thu May 12 09:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 09:56:22.723661 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-2fb929ff-e4a5-42fb-9ff9-f888008dc73a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:22.724259 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-2fb929ff-e4a5-42fb-9ff9-f888008dc73a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:22.731210 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb929ff-e4a5-42fb-9ff9-f888008dc73a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:22.731596 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb929ff-e4a5-42fb-9ff9-f888008dc73a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:22.732343 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb929ff-e4a5-42fb-9ff9-f888008dc73a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:22.732773 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-2fb929ff-e4a5-42fb-9ff9-f888008dc73a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:22.795618 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.policy [None req-2fb929ff-e4a5-42fb-9ff9-f888008dc73a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be00f6a9ad465195c7606883b4160d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e6bc2241970493783de557e3f690105', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123510) authorize /opt/stack/nova/nova/policy.py:199}} May 12 09:56:22.802853 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-2fb929ff-e4a5-42fb-9ff9-f888008dc73a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 200 len: 1223 microversion: 2.1 time: 0.083085 May 12 09:56:22.803410 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 644/1285] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:56:22 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 09:56:23.819557 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:23.820260 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: cf4d0b64-50c4-488e-88d7-29ab24ad4da8] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:23.826859 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:23.827311 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:23.828072 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:23.828505 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:23.841351 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] HTTP exception thrown: Instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 could not be found. May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Request method failure captured: May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 HTTP/1.1 May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNfsSGsklBQKgk2wz8_ns-oseYoeHnatXieF61uEo04yoCIDDZKrFK_4jpXSpv7-HLuPhwt0xwYvCRti6WGSjN25z8DetSurOaNBy0sexdbNJZUaLgjgrV3DHCZ6xyyT3ZOQrkR8uN1tbFWv-U40qZcBt0phwgL5wwmpUUmQcJorimM May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: 6e6bc2241970493783de557e3f690105 May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:56:23.842959 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e6bc2241970493783de557e3f690105", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e6bc2241970493783de557e3f690105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}] May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: 6e6bc2241970493783de557e3f690105 May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-TestVolumeBootPattern-1342689768-project May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 06be00f6a9ad465195c7606883b4160d May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-TestVolumeBootPattern-1342689768-project May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 could not be found. May 12 09:56:23.844673 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'cf4d0b64-50c4-488e-88d7-29ab24ad4da8'} May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 could not be found. May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:56:23.845692 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 could not be found. May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 could not be found. May 12 09:56:23.847329 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:23.848780 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Returning 404 to user: Instance cf4d0b64-50c4-488e-88d7-29ab24ad4da8 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:56:23.848780 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-5a5b8685-c884-45fb-9af8-7dbab5a08d51 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8" status: 404 len: 111 microversion: 2.1 time: 0.028994 May 12 09:56:23.848780 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 642/1286] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:56:23 2022] GET /compute/v2.1/servers/cf4d0b64-50c4-488e-88d7-29ab24ad4da8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 09:56:24.271896 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:24.272499 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.compute.api [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123510) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:24.279735 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:24.280183 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:24.280934 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:24.281365 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG oslo_concurrency.lockutils [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123510) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:24.294693 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.wsgi [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] HTTP exception thrown: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Request method failure captured: May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: request: DELETE /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 HTTP/1.1 May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept: application/json May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Accept-Encoding: identity May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Connection: close May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Length: 0 May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Content-Type: application/json May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Host: 10.222.0.60 May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Openstack-System-Scope: None May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: User-Agent: python-urllib3/1.26.9 May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Auth-Token: gAAAAABifNfsSGsklBQKgk2wz8_ns-oseYoeHnatXieF61uEo04yoCIDDZKrFK_4jpXSpv7-HLuPhwt0xwYvCRti6WGSjN25z8DetSurOaNBy0sexdbNJZUaLgjgrV3DHCZ6xyyT3ZOQrkR8uN1tbFWv-U40qZcBt0phwgL5wwmpUUmQcJorimM May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Id: None May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Domain-Name: None May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Identity-Status: Confirmed May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Is-Admin-Project: True May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Id: default May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Domain-Name: Default May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Id: 6e6bc2241970493783de557e3f690105 May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Project-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Role: reader,member May 12 09:56:24.296342 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Roles: reader,member May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e6bc2241970493783de557e3f690105", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e6bc2241970493783de557e3f690105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}] May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Id: 6e6bc2241970493783de557e3f690105 May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-Tenant-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User: tempest-TestVolumeBootPattern-1342689768-project May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Id: default May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Domain-Name: Default May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Id: 06be00f6a9ad465195c7606883b4160d May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: X-User-Name: tempest-TestVolumeBootPattern-1342689768-project May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: method: > May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: exception: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.298103 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: action_args: {'id': 'c701302e-c5c6-409c-9ec9-034448c9b961'} May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:56:24.299206 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.300857 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: ERROR nova.api.openstack.wsgi May 12 09:56:24.302699 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Returning 404 to user: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. {{(pid=123510) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:56:24.302699 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-dedd3700-a667-455f-bde6-34cc819bb1f6 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 404 len: 111 microversion: 2.1 time: 0.029884 May 12 09:56:24.302699 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 645/1287] 10.222.0.60 () {58 vars in 1238 bytes} [Thu May 12 09:56:24 2022] DELETE /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:56:24.306364 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '>' {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:24.306992 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.compute.api [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] [instance: c701302e-c5c6-409c-9ec9-034448c9b961] Fetching instance by UUID {{(pid=123509) get /opt/stack/nova/nova/compute/api.py:2920}} May 12 09:56:24.313137 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:24.313594 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:24.314427 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 12 09:56:24.314868 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG oslo_concurrency.lockutils [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Lock "1a13a725-2629-4ace-99a6-21ba5d823ec1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123509) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 12 09:56:24.328460 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.wsgi [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] HTTP exception thrown: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Request method failure captured: May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: request: GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 HTTP/1.1 May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept: application/json May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Accept-Encoding: identity May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Connection: close May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Length: 0 May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Content-Type: application/json May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Host: 10.222.0.60 May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Openstack-System-Scope: None May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: User-Agent: python-urllib3/1.26.9 May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Auth-Token: gAAAAABifNfsSGsklBQKgk2wz8_ns-oseYoeHnatXieF61uEo04yoCIDDZKrFK_4jpXSpv7-HLuPhwt0xwYvCRti6WGSjN25z8DetSurOaNBy0sexdbNJZUaLgjgrV3DHCZ6xyyT3ZOQrkR8uN1tbFWv-U40qZcBt0phwgL5wwmpUUmQcJorimM May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Id: None May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Domain-Name: None May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Identity-Status: Confirmed May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Is-Admin-Project: True May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Id: default May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Domain-Name: Default May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Id: 6e6bc2241970493783de557e3f690105 May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Project-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Role: reader,member May 12 09:56:24.329983 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Roles: reader,member May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:8080/v1/AUTH_6e6bc2241970493783de557e3f690105", "adminURL": "http://10.222.0.60:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/6e6bc2241970493783de557e3f690105"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/6e6bc2241970493783de557e3f690105"}]}] May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Id: 6e6bc2241970493783de557e3f690105 May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-Tenant-Name: tempest-TestVolumeBootPattern-1342689768 May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User: tempest-TestVolumeBootPattern-1342689768-project May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Id: default May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Domain-Name: Default May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Id: 06be00f6a9ad465195c7606883b4160d May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: X-User-Name: tempest-TestVolumeBootPattern-1342689768-project May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: method: > May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: exception: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.331766 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: action_args: {'id': 'c701302e-c5c6-409c-9ec9-034448c9b961'} May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: {{(pid=123509) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 12 09:56:24.332768 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. May 12 09:56:24.334416 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: ERROR nova.api.openstack.wsgi May 12 09:56:24.336229 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: DEBUG nova.api.openstack.wsgi [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Returning 404 to user: Instance c701302e-c5c6-409c-9ec9-034448c9b961 could not be found. {{(pid=123509) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 12 09:56:24.336229 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO nova.api.openstack.requestlog [None req-69bb9acc-f5c4-472d-aa20-84ee4c8e2f47 tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961" status: 404 len: 111 microversion: 2.1 time: 0.028866 May 12 09:56:24.336229 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: [pid: 123509|app: 0|req: 643/1288] 10.222.0.60 () {58 vars in 1235 bytes} [Thu May 12 09:56:24 2022] GET /compute/v2.1/servers/c701302e-c5c6-409c-9ec9-034448c9b961 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 09:56:25.612038 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: DEBUG nova.api.openstack.wsgi [None req-133d2e83-ae3e-4dac-96ec-98dead4ca28a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] Calling method '.version_select at 0x7f87256de9d0>' {{(pid=123510) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 09:56:25.645084 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO nova.api.openstack.requestlog [None req-133d2e83-ae3e-4dac-96ec-98dead4ca28a tempest-TestVolumeBootPattern-1342689768 tempest-TestVolumeBootPattern-1342689768-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-744304972" status: 202 len: 0 microversion: 2.1 time: 0.036775 May 12 09:56:25.645801 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: [pid: 123510|app: 0|req: 646/1289] 10.222.0.60 () {58 vars in 1259 bytes} [Thu May 12 09:56:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-744304972 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 09:57:11.953059 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:57:11.953677 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Thu May 12 09:57:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:57:19.670795 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:57:19.671383 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Thu May 12 09:57:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:58:50.556720 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:58:50.557345 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Thu May 12 09:58:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:59:03.039507 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:59:03.040189 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Thu May 12 09:59:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:59:05.348137 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:59:05.348810 dv-cinder-837699-5-iscsi devstack@n-api.service[123510]: Thu May 12 09:59:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 09:59:31.636550 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 09:59:31.637167 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Thu May 12 09:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 10:00:31.961203 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 10:00:31.961951 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Thu May 12 10:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 10:00:39.679748 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 10:00:39.680335 dv-cinder-837699-5-iscsi devstack@n-api.service[123509]: Thu May 12 10:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!